-- Logs begin at Mon 2022-05-23 11:58:16 UTC, end at Mon 2022-05-23 13:04:39 UTC. -- May 23 12:32:19.540445 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... May 23 12:32:19.553488 dv-cinder-master-3-smb devstack@keystone.service[90313]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 12:32:19 2022] *** May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: nodename: dv-cinder-master-3-smb May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: machine: x86_64 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: clock source: unix May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: pcre jit disabled May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: detected number of CPU cores: 4 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: current working directory: / May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: detected binary path: /usr/bin/uwsgi-core May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: your processes number limit is 47680 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: your memory page size is 4096 bytes May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: detected max file descriptor number: 2048 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: lock engine: pthread robust mutexes May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: thunder lock: enabled May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 12:32:19.554028 dv-cinder-master-3-smb devstack@keystone.service[90313]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 12:32:19.598599 dv-cinder-master-3-smb devstack@keystone.service[90313]: Python main interpreter initialized at 0x560bbce5c9c0 May 23 12:32:19.598599 dv-cinder-master-3-smb devstack@keystone.service[90313]: python threads support enabled May 23 12:32:19.598599 dv-cinder-master-3-smb devstack@keystone.service[90313]: your server socket listen backlog is limited to 100 connections May 23 12:32:19.598599 dv-cinder-master-3-smb devstack@keystone.service[90313]: your mercy for graceful operations on workers is 90 seconds May 23 12:32:19.598915 dv-cinder-master-3-smb devstack@keystone.service[90313]: mapped 403077 bytes (393 KB) for 2 cores May 23 12:32:19.598977 dv-cinder-master-3-smb devstack@keystone.service[90313]: *** Operational MODE: preforking *** May 23 12:32:19.599240 dv-cinder-master-3-smb devstack@keystone.service[90313]: *** uWSGI is running in multiple interpreter mode *** May 23 12:32:19.599240 dv-cinder-master-3-smb devstack@keystone.service[90313]: spawned uWSGI master process (pid: 90313) May 23 12:32:19.599437 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. May 23 12:32:19.602262 dv-cinder-master-3-smb devstack@keystone.service[90313]: spawned uWSGI worker 1 (pid: 90355, cores: 1) May 23 12:32:19.602262 dv-cinder-master-3-smb devstack@keystone.service[90313]: spawned uWSGI worker 2 (pid: 90356, cores: 1) May 23 12:32:19.602262 dv-cinder-master-3-smb devstack@keystone.service[90313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 12:32:25.352377 dv-cinder-master-3-smb devstack@keystone.service[90355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:25.352377 dv-cinder-master-3-smb devstack@keystone.service[90355]: from cryptography.utils import int_from_bytes May 23 12:32:25.353045 dv-cinder-master-3-smb devstack@keystone.service[90356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:25.353045 dv-cinder-master-3-smb devstack@keystone.service[90356]: from cryptography.utils import int_from_bytes May 23 12:32:25.353045 dv-cinder-master-3-smb devstack@keystone.service[90356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:25.353045 dv-cinder-master-3-smb devstack@keystone.service[90356]: from cryptography.utils import int_from_bytes May 23 12:32:25.353551 dv-cinder-master-3-smb devstack@keystone.service[90355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:32:25.353551 dv-cinder-master-3-smb devstack@keystone.service[90355]: from cryptography.utils import int_from_bytes May 23 12:32:25.403093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:32:25.403283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:32:25.403370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:32:25.403462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] command line args: [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:32:25.403572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:32:25.403712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:32:25.403798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] command line args: [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:32:25.403897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ================================================================================ {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:32:25.404018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:32:25.404149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] admin_token = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ================================================================================ {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:32:25.404394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] config_dir = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404474 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] admin_token = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] config_dir = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404762 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] config_source = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.404925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] debug = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] config_source = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] debug = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405569 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.405955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_config_append = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_config_append = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.406968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_dir = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_dir = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_file = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_file = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.407954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.408989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.409613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.409806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.409906 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.410997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.411138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.411264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.411623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.411756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.411871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] publish_errors = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.411983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] publish_errors = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.412976 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] standard_threads = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] standard_threads = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.413918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] use_journal = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] use_journal = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] use_json = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] use_json = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] use_stderr = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] use_stderr = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.414950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] use_syslog = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.415062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] use_syslog = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.415180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.415294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:32:25.415407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.415528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.415648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.415761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.415879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.415999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.416901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417328 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.417921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.418975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.419906 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.420937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.421920 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.422909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.423978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.424093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.424205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.424317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.424429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.424540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.424661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.425408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.425534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.425648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.425762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.425943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.426930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.427921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.428959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.429919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430032 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.430876 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.431930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.432945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.433917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.434926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.435977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.436891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437765 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.437882 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.438949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.439885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.external = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.440991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.external = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.441918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.password = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.password = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] auth.token = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] auth.token = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.442854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.443993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.444898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.445846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.446950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.447889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.448859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.449790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.450924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.451995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.452930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.453884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454242 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.454946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455060 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.455893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.456997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.457974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.458893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.459811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.460932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.461900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.462936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463051 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.463992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.464919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.465878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.466940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.467884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.468945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.469927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.470857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.471049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.471169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.471285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.471400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.471515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.472976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] role.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] role.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473570 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.473933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474164 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.474982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] role.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.475924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] role.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.476972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.477950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.478886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.479927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.480995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.481900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.482264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.482390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.482508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.482664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.482825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.482941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.483885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484732 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.484961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.connection = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.485929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.486888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.487005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.487120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.487308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.487964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.488825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.connection = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.489915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490032 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:32:25.490849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.490849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.491446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.491446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.491446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.491769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.491891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.492080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.492315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.492559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.492796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:32:25.492966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:32:25.524279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.524506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.524731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.527908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.528138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.528363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.533408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.537849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.562343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.562567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.564314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.564547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.616483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.616616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.667824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.668056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.669701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.669936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.735499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.735725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.735951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.736173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.736392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.736609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.737990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.738297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.738586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.738870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.739153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.739460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.761349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.761477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.761583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.761667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.761812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.761895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.762749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.774188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.774378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.786830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.787920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.788001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.788129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.788220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.788341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:32:25.807997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.808179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.808267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:32:25.808393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:32:25.808528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.808728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.808810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:32:25.808928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:32:25.809011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.809994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.821283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.821563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.821690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.821834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.821965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.822113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.822233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.822510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.830313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.830623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.833769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.833979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.834066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.834262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.834358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.834543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.834626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.834824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.834908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.835096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.835187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.835350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.835474 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.835728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.835809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836087 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.836811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.864083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.864182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.865831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.865918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.866114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.866198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.871417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.871514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.871647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.871739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.871922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.872004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.879837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.879933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.880118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.880202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.884596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.884686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.884997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.885079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.885306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.885392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.885592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.885675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.885871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.886765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.905303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.905403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.905580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.905663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.910841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.910968 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.914518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.914608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.914812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.914911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.919834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.919919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.923450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.923538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.927397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.927584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.927696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.927883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.927990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.928177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.928261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.928461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.928541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.928746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.928835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.929031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.948350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.948601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.948686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.948887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.948967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.949166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.949248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.949430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.957371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.957648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.959084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.959343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.959423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.959627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.962410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.962695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.962775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.962974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.963053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.963256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.963347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.963541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.963620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.963819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.977810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.978089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.978369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.978661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.978942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.979217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.979489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.979568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.979804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.980083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.980366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.980644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.980916 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.981226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:25.997919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:25.999705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.001194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.003596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.005072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.006690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.008323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.008619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.008704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.008900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.010501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.012150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.012443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.012719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.016313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.017967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.020777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.022105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.022394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.022481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.022677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.022951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.025959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.026255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.026538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.026812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.032061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.032348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.032727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.036056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.036342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.036728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.040823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.041103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.041411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.041694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.041970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.042250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.042546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.042795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.043070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.043343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.043610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.043878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.044149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.044409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.045562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:32:26.045850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.046131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.046405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.046687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.046961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.047245 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.047512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.047790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.048057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.048324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.048592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.048862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.049130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:32:26.088709 dv-cinder-master-3-smb devstack@keystone.service[90356]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560bbce5c9c0 pid: 90356 (default app) May 23 12:32:26.092044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39126-2a6c-475c-9ae7-5191e01a59eb None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:26.092351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39126-2a6c-475c-9ae7-5191e01a59eb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:26.092614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39126-2a6c-475c-9ae7-5191e01a59eb None None] PATH_INFO: `/v3` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:26.093432 dv-cinder-master-3-smb devstack@keystone.service[90355]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560bbce5c9c0 pid: 90355 (default app) May 23 12:32:26.097765 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Mon May 23 12:32:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:34.134699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044028f9-83bf-4ad7-8583-407035242684 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:34.135278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044028f9-83bf-4ad7-8583-407035242684 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:34.135278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044028f9-83bf-4ad7-8583-407035242684 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:34.140070 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:32:34.146518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:34.146985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:34.147440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:34.218664 dv-cinder-master-3-smb devstack@keystone.service[90356]: INFO dbcounter [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] Registered counter for database keystone May 23 12:32:34.241602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG oslo_db.sqlalchemy.engines [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:34.248241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writer thread running {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:34.443051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG passlib.handlers.bcrypt [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=90356) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 12:32:34.443384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG passlib.handlers.bcrypt [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90356) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 12:32:34.511560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:34.513201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:34.654335 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 23 12:32:34.847317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044028f9-83bf-4ad7-8583-407035242684 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:34.916315 dv-cinder-master-3-smb devstack@keystone.service[90355]: INFO dbcounter [None req-044028f9-83bf-4ad7-8583-407035242684 None None] Registered counter for database keystone May 23 12:32:34.935479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG oslo_db.sqlalchemy.engines [None req-044028f9-83bf-4ad7-8583-407035242684 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:32:34.942093 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writer thread running {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:32:35.060515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044028f9-83bf-4ad7-8583-407035242684 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:35.064766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:35.066065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:35.066345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:35.066621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:35.074787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:35.126260 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 12:32:35.126547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ddb6-62bb-437d-afc8-2dd916709577 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:35.136789 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Mon May 23 12:32:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:32:35.143204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:35.158302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4c3b-665c-44e4-ad91-e5d38da7333b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:35.163272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:35.164367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:35.164658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:35.164938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] PATH_INFO: `/v3/projects/42a3411808a2449f8a4f73e9a1925a0f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:35.166511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] RBAC: Authorizing `identity:get_project(project_id=42a3411808a2449f8a4f73e9a1925a0f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:35.325685 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING keystone.common.rbac_enforcer.enforcer [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 12:32:35.326040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70f91-fe01-4ce9-b42c-fa089a51b055 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:35.331294 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Mon May 23 12:32:35 2022] GET /identity/v3/projects/42a3411808a2449f8a4f73e9a1925a0f => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:37.501070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bd37f-35ce-4714-9ee6-ec88771565c4 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:37.501625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bd37f-35ce-4714-9ee6-ec88771565c4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:37.501732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bd37f-35ce-4714-9ee6-ec88771565c4 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:37.505934 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:37.511343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:37.511752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:37.511902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:37.531619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:37.533169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:37.541693 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 12:32:37.563901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bd37f-35ce-4714-9ee6-ec88771565c4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:37.576301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bd37f-35ce-4714-9ee6-ec88771565c4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:37.581029 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e367487-166e-4120-9c20-2a32b568568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:37.581822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367487-166e-4120-9c20-2a32b568568c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:37.582059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367487-166e-4120-9c20-2a32b568568c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:37.582331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367487-166e-4120-9c20-2a32b568568c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:37.589928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e367487-166e-4120-9c20-2a32b568568c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:37.591689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e367487-166e-4120-9c20-2a32b568568c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:37.601044 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Mon May 23 12:32:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:32:37.606944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:37.616134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d64fc-d32e-4c6a-b212-35026fd331fd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:37.620664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e36c3-9d47-4255-9cff-c74e8bfe857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:37.621556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e36c3-9d47-4255-9cff-c74e8bfe857e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:37.621841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e36c3-9d47-4255-9cff-c74e8bfe857e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:37.622115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e36c3-9d47-4255-9cff-c74e8bfe857e admin admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:37.623514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e36c3-9d47-4255-9cff-c74e8bfe857e admin admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:37.625378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e36c3-9d47-4255-9cff-c74e8bfe857e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:37.626966 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Mon May 23 12:32:37 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:39.902908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618235f-6077-4384-b86e-cd212fe96783 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:39.903448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618235f-6077-4384-b86e-cd212fe96783 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:39.903448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618235f-6077-4384-b86e-cd212fe96783 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:39.904807 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:39.910933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:39.911337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:39.911434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da3ba-e1d3-4320-8922-2c67dc5ca909 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:39.911605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da3ba-e1d3-4320-8922-2c67dc5ca909 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:39.911704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:39.911888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da3ba-e1d3-4320-8922-2c67dc5ca909 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:39.913163 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:32:39.918186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:39.918475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:39.918757 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:39.928585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:39.929820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:39.957999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG passlib.handlers.bcrypt [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=90355) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 12:32:39.958428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG passlib.handlers.bcrypt [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90355) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 12:32:40.005521 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:40.007111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:40.009392 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:40.032846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.056553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.106161 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:32:40.128926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.137690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dde30-780b-4fbe-9991-f9e86e40ded9 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.173383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.174106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.174416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.174700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.186055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:40.197806 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:40.198927 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:32:40.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:32:40.207012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.295610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.315375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99ae6-c227-4530-ab6a-b1c0b8d80209 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.341524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1646-4ffe-43f7-91d6-a05c9f2dfb5c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.344005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.350844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.351516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.351801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.352084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.352840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:40.353167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.354590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.367693 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:40.373218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.383277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.384182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.384469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.384747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.454097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.456066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.472796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44014-a201-4f76-89e7-8dbf82fe1fb2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.507438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.508299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.508577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.508849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.510078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.511523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.513132 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 9/16] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:40.518867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.532980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.553791 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 8/17] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:32:40.559293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.562005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.620863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196be30-4c0a-4469-b2ee-28df60c15225 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.655577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.656369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.656655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.656946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.659775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.659986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb00bd-5b09-4f62-8d7b-8095361f4370 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.661645 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:40.667408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.698675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.699541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.699824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.700103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.718698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.720171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:32:40.741483 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:40.742278 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:40.743053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:32:40.743053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:32:40.743053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:32:40.743053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:32:40.743053 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:32:40.748556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:40.748865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.769781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268be06-2fce-4b93-92e5-c574ad211467 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.803834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.804477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.804756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.805207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.805316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:40.805900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.domain.id=default, user.id=a725360ad03a444db8a80dca5cc7c54a) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:40.806286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.807837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ae25-8c38-495b-b7d6-fcc3541e01e5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.814612 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/role_assignments?user.id=a725360ad03a444db8a80dca5cc7c54a&scope.domain.id=default&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:40.852978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18fd93-6295-4dcb-a83d-36d8484731a6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:40.890363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:40.891039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:40.891323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:40.891600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:40.892337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:40.892644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:40.894856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e442846-966a-45b0-b4b0-e50ee6de7299 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:40.915600 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:43.431514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ab2bc-a58a-4f7e-bb5f-8f63971df7ca None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.432504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ab2bc-a58a-4f7e-bb5f-8f63971df7ca None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.433078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ab2bc-a58a-4f7e-bb5f-8f63971df7ca None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.434782 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:43.447269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e107-e2dd-4fb4-bd57-e5eab318ba43 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.447781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e107-e2dd-4fb4-bd57-e5eab318ba43 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.447883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e107-e2dd-4fb4-bd57-e5eab318ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.478231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2c97e107-e2dd-4fb4-bd57-e5eab318ba43 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:43.479546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2c97e107-e2dd-4fb4-bd57-e5eab318ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:43.572302 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 11/23] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:43.607987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ab2bc-a58a-4f7e-bb5f-8f63971df7ca None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:43.686323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86211-2ea2-4345-9d44-a2847cbf4aca None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.686841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86211-2ea2-4345-9d44-a2847cbf4aca None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.687326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86211-2ea2-4345-9d44-a2847cbf4aca None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.688891 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:43.695003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e86a-1ca5-4a95-b2ba-122e9ae4b751 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.695543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e86a-1ca5-4a95-b2ba-122e9ae4b751 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.696015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e86a-1ca5-4a95-b2ba-122e9ae4b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.730241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1525e86a-1ca5-4a95-b2ba-122e9ae4b751 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:43.732005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1525e86a-1ca5-4a95-b2ba-122e9ae4b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:43.781847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ab2bc-a58a-4f7e-bb5f-8f63971df7ca None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:43.831676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:43.853894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:43.854692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.854977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.855257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.877355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:43.885172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:43.886065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:43.886795 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:32:43.887340 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 23 12:32:43.888643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ea20f-ddd8-4ea8-be41-5646b580e895 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.888873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ea20f-ddd8-4ea8-be41-5646b580e895 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.889169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ea20f-ddd8-4ea8-be41-5646b580e895 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.890470 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:43.894520 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:32:43.896569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994832-7927-4895-9de9-6433d04a86bf None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:43.897047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994832-7927-4895-9de9-6433d04a86bf None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:43.897496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994832-7927-4895-9de9-6433d04a86bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:43.899894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:43.909921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:43.916670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-26994832-7927-4895-9de9-6433d04a86bf None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:43.918153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-26994832-7927-4895-9de9-6433d04a86bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:43.993002 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 15/28] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:43.998280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26994832-7927-4895-9de9-6433d04a86bf None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.126956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26994832-7927-4895-9de9-6433d04a86bf None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.137228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d234e8-97cc-4914-979e-489136d2c9b3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.161547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:44.165759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.167056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.167564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.168042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.181492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.181670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.182355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.182640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.183116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.183972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:44.184279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.184501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.185887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.196011 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:44.197113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:32:44.205026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:44.207052 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:44.208021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:32:44.208021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:32:44.208021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:32:44.208021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:32:44.209203 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 16/30] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:32:44.210311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.271685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:44.317511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8ba7a-f066-47cb-ae11-7fdccc2a9a0c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.323004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a8154-272d-4cd1-ac8e-3dfdccfb2dd8 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.375053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.376318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.376822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.377917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.379739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.381466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.383456 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 17/31] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:44 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:44.384664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.385686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ae37-517a-49ae-9846-622332041493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.386421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ae37-517a-49ae-9846-622332041493 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.386700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ae37-517a-49ae-9846-622332041493 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.386975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ae37-517a-49ae-9846-622332041493 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.387827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ae37-517a-49ae-9846-622332041493 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.394057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ae37-517a-49ae-9846-622332041493 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.449617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:44.497486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b990a12-c55f-4d07-9162-117bf64df339 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.535126 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.536175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.536662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.537172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.538209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:44.538717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.540307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.554204 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 18/32] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:44.555363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.589891 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 15/33] 10.222.0.45 () {60 vars in 1131 bytes} [Mon May 23 12:32:44 2022] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:44.592911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953df2-ac60-400d-a533-f38eab732f51 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.593437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953df2-ac60-400d-a533-f38eab732f51 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.594206 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953df2-ac60-400d-a533-f38eab732f51 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.595968 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 16/34] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:44.597489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7953df2-ac60-400d-a533-f38eab732f51 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.717591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:44.725468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655920-02ec-41ca-b742-ba589d730adf None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.755889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7953df2-ac60-400d-a533-f38eab732f51 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:44.785671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:44.793779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.794861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.795391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.795862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.796844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.798802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.810587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90232a5-a384-4f88-afc0-d6109a71f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:44.811517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90232a5-a384-4f88-afc0-d6109a71f914 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.811812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90232a5-a384-4f88-afc0-d6109a71f914 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.812092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90232a5-a384-4f88-afc0-d6109a71f914 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.813327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90232a5-a384-4f88-afc0-d6109a71f914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:44.815333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90232a5-a384-4f88-afc0-d6109a71f914 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:44.817184 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 19/35] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:44.824430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:44.829724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:44.830398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:44.833421 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 17/36] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:32:44 2022] POST /identity/v3/projects => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:44.834585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:44.856280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:44.857741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:44.965927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78303f4f-c55d-4a7a-8020-02717d706572 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:45.007475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918b78-6944-44d1-8907-2860be0aaaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:45.008743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918b78-6944-44d1-8907-2860be0aaaeb None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.009279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918b78-6944-44d1-8907-2860be0aaaeb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.009765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918b78-6944-44d1-8907-2860be0aaaeb None admin] PATH_INFO: `/v3/domains/default/users/a725360ad03a444db8a80dca5cc7c54a/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.012493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918b78-6944-44d1-8907-2860be0aaaeb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a725360ad03a444db8a80dca5cc7c54a, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:45.014347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918b78-6944-44d1-8907-2860be0aaaeb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:45.026446 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 20/37] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:45.034606 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 18/38] 10.222.0.45 () {58 vars in 1361 bytes} [Mon May 23 12:32:44 2022] PUT /identity/v3/domains/default/users/a725360ad03a444db8a80dca5cc7c54a/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:32:45.053665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:45.170921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4cb6c-9303-4136-8560-bf9c015c4509 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.171630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4cb6c-9303-4136-8560-bf9c015c4509 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.172172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4cb6c-9303-4136-8560-bf9c015c4509 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.174438 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 19/39] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:45.180291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:45.183536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64efec-7144-4a3d-8bda-2dd29d46a989 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.184161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64efec-7144-4a3d-8bda-2dd29d46a989 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.184662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64efec-7144-4a3d-8bda-2dd29d46a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.198364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6394395-6040-4807-841f-688890d4c7d1 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:45.206073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8a64efec-7144-4a3d-8bda-2dd29d46a989 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:45.208356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8a64efec-7144-4a3d-8bda-2dd29d46a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:45.245813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:45.246504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:45.246854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.247308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.247867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.248525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:45.253620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:45.307582 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 20/40] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:45.309336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5f683-0520-4f3a-a107-5e66f79e4d77 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.309799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5f683-0520-4f3a-a107-5e66f79e4d77 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.310248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5f683-0520-4f3a-a107-5e66f79e4d77 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.311946 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 21/41] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:45.319102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.319398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.319689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.338001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:45.339335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:45.395062 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1131 bytes} [Mon May 23 12:32:45 2022] POST /identity/v3/roles => generated 225 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:45.402545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:45.414532 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 22/43] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:32:45.439186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:45.529172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2d80-b5a8-4839-9665-e388186c21d9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:45.549559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:45.554378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11d789-febd-4899-9c24-de56a6d5201b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:45.566834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:45.567566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.567850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.568128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.569519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:45.571146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:45.572868 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 22/44] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:45.578508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:45.595083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:45.598005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3f3b2-68fd-4de4-9826-363237345a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:45.598689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3f3b2-68fd-4de4-9826-363237345a42 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.599027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3f3b2-68fd-4de4-9826-363237345a42 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.599309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3f3b2-68fd-4de4-9826-363237345a42 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.600869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3f3b2-68fd-4de4-9826-363237345a42 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:45.603354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3f3b2-68fd-4de4-9826-363237345a42 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:45.621474 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1131 bytes} [Mon May 23 12:32:45 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:32:45.708689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335cb17-533b-4593-939e-2d854c9dbc86 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:45.761166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457badd-b9b3-43fe-98a6-9859336b1858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:45.761166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457badd-b9b3-43fe-98a6-9859336b1858 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:45.761166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457badd-b9b3-43fe-98a6-9859336b1858 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:45.761477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457badd-b9b3-43fe-98a6-9859336b1858 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:45.765163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457badd-b9b3-43fe-98a6-9859336b1858 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:45.765163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457badd-b9b3-43fe-98a6-9859336b1858 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:45.795282 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:32:45 2022] POST /identity/v3/projects => generated 312 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:47.349058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbab1e-5f86-492b-88e9-c09ec92ad7a0 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:47.349531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbab1e-5f86-492b-88e9-c09ec92ad7a0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:47.349644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbab1e-5f86-492b-88e9-c09ec92ad7a0 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:47.351015 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 24/47] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:47.356256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:47.356930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:47.357184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:47.374803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:47.376304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:47.435050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:47.445021 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:47.467666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbab1e-5f86-492b-88e9-c09ec92ad7a0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:47.569296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbab1e-5f86-492b-88e9-c09ec92ad7a0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:47.601847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:47.602557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:47.602845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:47.603121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:47.613897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:47.621428 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:47.622394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:32:47.623307 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 25/49] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:32:47.630550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:47.728658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aef3e-1ed8-494d-8e32-f1fa904d2e6e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:47.762461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:47.763137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:47.763423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:47.763708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:47.764462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:47.764775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:47.766197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:47.777968 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 25/50] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:47.784006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:47.804282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:47.888495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2eb1-1d18-41a9-bc00-7704c3e64704 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:47.922856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabd981-743e-4b4d-ae54-cff5f451265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:47.923723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd981-743e-4b4d-ae54-cff5f451265e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:47.924062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd981-743e-4b4d-ae54-cff5f451265e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:47.924344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd981-743e-4b4d-ae54-cff5f451265e None admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:47.925625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabd981-743e-4b4d-ae54-cff5f451265e None admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:47.927098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabd981-743e-4b4d-ae54-cff5f451265e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:47.928738 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 26/51] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:47 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:47.934319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:47.991769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:48.036895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de8d4-59e5-4df1-a658-5d70961bed02 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:48.050628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bba54-9566-4b78-b489-d1dad08e36f9 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:48.050999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bba54-9566-4b78-b489-d1dad08e36f9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:48.051364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bba54-9566-4b78-b489-d1dad08e36f9 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:48.052804 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 27/52] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:32:48.057683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:48.057970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:48.058249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:48.070883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:48.071672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:48.071956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:48.072234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:48.073452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:48.074909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:48.075387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:48.076509 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:48.076603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:48.082581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:48.144313 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 28/54] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:32:48.167901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:48.182049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc5ec-0497-4acf-8663-796e4eef63f0 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:48.184820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:48.206834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:48.217804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:48.218462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:48.218746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:48.219025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:48.219855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.domain.id=default, user.id=a725360ad03a444db8a80dca5cc7c54a) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:48.220166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:48.222440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:48.230953 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1322 bytes} [Mon May 23 12:32:48 2022] GET /identity/v3/role_assignments?user.id=a725360ad03a444db8a80dca5cc7c54a&scope.domain.id=default&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:48.271088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84dd5e-5f40-4522-bbe7-5e21b94d5c5a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:48.307720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92089f66-c07e-4561-b1c0-ef27924404a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:48.308532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92089f66-c07e-4561-b1c0-ef27924404a5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:48.308819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92089f66-c07e-4561-b1c0-ef27924404a5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:48.309099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92089f66-c07e-4561-b1c0-ef27924404a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:48.310407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92089f66-c07e-4561-b1c0-ef27924404a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:48.311887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92089f66-c07e-4561-b1c0-ef27924404a5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:48.313604 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 29/56] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:48.319475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:48.429317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377dc09-173e-4a9c-b8aa-e44f99b8411e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:48.462835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee0cf3-e5a1-49cb-8174-493e92b8f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:48.463580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0cf3-e5a1-49cb-8174-493e92b8f024 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:48.463868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0cf3-e5a1-49cb-8174-493e92b8f024 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:48.464150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0cf3-e5a1-49cb-8174-493e92b8f024 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:48.464874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee0cf3-e5a1-49cb-8174-493e92b8f024 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:48.466454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee0cf3-e5a1-49cb-8174-493e92b8f024 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:48.493710 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 28/57] 10.222.0.45 () {60 vars in 1140 bytes} [Mon May 23 12:32:48 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:50.671621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438edb3b-9a58-42d2-8602-fd5cd06751e2 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:50.672116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438edb3b-9a58-42d2-8602-fd5cd06751e2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:50.672116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438edb3b-9a58-42d2-8602-fd5cd06751e2 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:50.673510 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:50.678802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:50.679209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:50.679367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:50.696373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:50.697598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:50.731134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:50.764162 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:50.789052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438edb3b-9a58-42d2-8602-fd5cd06751e2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:50.871795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:50.888167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438edb3b-9a58-42d2-8602-fd5cd06751e2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:50.921186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca3418-934d-4c6f-954d-bf6cb960c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:50.922021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca3418-934d-4c6f-954d-bf6cb960c50e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:50.922256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca3418-934d-4c6f-954d-bf6cb960c50e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:50.922536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca3418-934d-4c6f-954d-bf6cb960c50e None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:50.923793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca3418-934d-4c6f-954d-bf6cb960c50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:50.925811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca3418-934d-4c6f-954d-bf6cb960c50e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:50.927414 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 31/60] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:50.932870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:51.031352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9666bef-fda4-4d37-82df-d926e05e6493 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:51.064437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31c7f0-e398-43c7-a12b-1e5303aa7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:51.065357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31c7f0-e398-43c7-a12b-1e5303aa7cfc None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:51.065647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31c7f0-e398-43c7-a12b-1e5303aa7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:51.065932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31c7f0-e398-43c7-a12b-1e5303aa7cfc None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:51.066637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31c7f0-e398-43c7-a12b-1e5303aa7cfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:51.068080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31c7f0-e398-43c7-a12b-1e5303aa7cfc None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:51.093543 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 30/61] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:32:50 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:54.581977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5076-58c9-4abe-8d3c-5c861ee83b62 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.583080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5076-58c9-4abe-8d3c-5c861ee83b62 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.583581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5076-58c9-4abe-8d3c-5c861ee83b62 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.585321 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 32/62] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:54.587186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73b702-7529-42d0-94a1-40336f3634da None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.588023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73b702-7529-42d0-94a1-40336f3634da None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.588505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73b702-7529-42d0-94a1-40336f3634da None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.590904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.591429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.591927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.594385 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:54.601108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.601664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.602094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.619954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:54.621213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:54.622803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:54.624313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:54.647333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:54.719329 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 33/64] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:32:54.743936 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 32/65] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:54.756710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:54.807666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:54.876318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:54.899314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0267-43e4-48fc-9fcf-48b01c16e925 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:54.924976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554cd4e-52d9-49c4-9531-f9ed618e045b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:54.938242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a205e8c-9b41-4d4d-a0f0-c9ce19f4c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:54.939037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205e8c-9b41-4d4d-a0f0-c9ce19f4c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.939383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205e8c-9b41-4d4d-a0f0-c9ce19f4c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.939661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205e8c-9b41-4d4d-a0f0-c9ce19f4c3f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.951672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a205e8c-9b41-4d4d-a0f0-c9ce19f4c3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:54.961368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005952f6-3074-48e9-9460-1c2a0128b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2a205e8c-9b41-4d4d-a0f0-c9ce19f4c3f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:54.961658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:54.962464 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:32:54.963363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:32:54.963917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005952f6-3074-48e9-9460-1c2a0128b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.963917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005952f6-3074-48e9-9460-1c2a0128b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.963917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005952f6-3074-48e9-9460-1c2a0128b7c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.964082 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 34/66] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:32:54.964142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ce0-9abc-402b-a8eb-84d7349ea91b None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.965049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ce0-9abc-402b-a8eb-84d7349ea91b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.965049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ce0-9abc-402b-a8eb-84d7349ea91b None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.969193 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 35/67] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:54.970573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca8c4-b2b3-49d6-af12-18c0e07dc062 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.971391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca8c4-b2b3-49d6-af12-18c0e07dc062 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.971685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca8c4-b2b3-49d6-af12-18c0e07dc062 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:54.973367 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 36/68] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:54.978009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ca8c4-b2b3-49d6-af12-18c0e07dc062 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:54.981221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005952f6-3074-48e9-9460-1c2a0128b7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-005952f6-3074-48e9-9460-1c2a0128b7c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:54.990811 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:54.991659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:32:54.992388 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 33/69] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:32:54.998475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab0db-1cc8-4475-a309-ba3784b2d6d4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:54.998475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab0db-1cc8-4475-a309-ba3784b2d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:54.998475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab0db-1cc8-4475-a309-ba3784b2d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.010919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f2fab0db-1cc8-4475-a309-ba3784b2d6d4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:55.012108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f2fab0db-1cc8-4475-a309-ba3784b2d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:55.024643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.086725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ca8c4-b2b3-49d6-af12-18c0e07dc062 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.097089 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:55.097089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f546280-41c9-4ba3-9aaf-283fd9dd1da5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.097089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f546280-41c9-4ba3-9aaf-283fd9dd1da5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.097089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f546280-41c9-4ba3-9aaf-283fd9dd1da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.115714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8f546280-41c9-4ba3-9aaf-283fd9dd1da5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:55.116945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8f546280-41c9-4ba3-9aaf-283fd9dd1da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:55.132428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.133311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.133592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.133869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.134637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] RBAC: Adding query filter params (name=member) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:55.134947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.136321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.144884 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 37/71] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.145708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.150660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.183965 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 35/72] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:55.196283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61f8e1-57cc-47ea-b40a-defdd3973451 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.196283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61f8e1-57cc-47ea-b40a-defdd3973451 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.196283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61f8e1-57cc-47ea-b40a-defdd3973451 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.196283 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 36/73] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:55.196283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61f8e1-57cc-47ea-b40a-defdd3973451 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.262168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12739e-2922-4db8-8797-953539ee03cd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.266574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.291788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61f8e1-57cc-47ea-b40a-defdd3973451 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.297325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.297988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.298270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.298544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.299700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:55.300005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.301421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.309936 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 38/74] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.309936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.329817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712d5e9-2041-486d-9b36-2b93a3c933cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.331427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d5e9-2041-486d-9b36-2b93a3c933cf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.332060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d5e9-2041-486d-9b36-2b93a3c933cf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.332060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d5e9-2041-486d-9b36-2b93a3c933cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.342293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712d5e9-2041-486d-9b36-2b93a3c933cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-a712d5e9-2041-486d-9b36-2b93a3c933cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:55.350212 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:55.351049 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:32:55.357104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.357942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.357942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.369830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:55.371037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:55.385655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.420571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c7d01-8627-4b29-b8a4-2f401dbd66c8 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.437939 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 38/76] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:55.442022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.454818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.456464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.456747 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.457035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.471235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.472910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.474627 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 39/77] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.475401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.513132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.548989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63d6f-6c6f-4734-8aa4-6daebea6140f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.574015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e7031-05c1-484a-a981-e7f744a6f0b1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.582007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.582957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.583244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.583524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.593730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:32:55.597982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:32:55.602186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:32:55.603021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:32:55.603783 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 39/78] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:32:55.604400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.613992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.614978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.615262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.615548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.616792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.618298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.619934 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 40/79] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.620704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.708073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308be09-1c6a-4762-8d9a-ab8d6671626b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.722638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acbdc0-ba35-4165-8c71-4f53bda26eff None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.732907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.742619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.743294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.743584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.743869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.744630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:55.744948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.746384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.755460 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 40/80] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.756062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.762824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.763624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.763911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.764192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.765407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.766882 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.768552 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 41/81] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.769345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.833794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.860274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75369f-d2a0-4ae8-8a12-f7d914294f39 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.875436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3fb1-1959-401a-bb76-fdf714001276 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:55.894429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.895085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.895375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.895659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.909468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:55.910144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:55.910435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:55.910719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:55.911474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:55.911788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.913218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:55.921120 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 42/82] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:55.922357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:55.955222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:55.968183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:55.969839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.021066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f0470-7f70-4670-8c46-2af0b5de2445 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.043367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.055162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.055805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.056092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.056377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.068997 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 41/83] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:32:56.069940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.124073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.125606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.159706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.171931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a936b2-3db6-43e8-b1b1-850521c7016a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.205712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.206586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.206874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.207163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.208349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.209842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.211467 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 42/84] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:56.216596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.225122 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 43/85] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:32:56.225943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.249544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.322108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d865-66e8-48f9-8047-d950931cf3b4 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.329652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccd79a-281f-417a-8ea7-4ac5c008dfa6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.358039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.358715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.359004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.359287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.360006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.361641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.365837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.366703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.366989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.367265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.368455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.369932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.371560 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 44/86] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:56.374204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.381865 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 43/87] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:32:56 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:32:56.382749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.401012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.489618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.500892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986705c-44c5-409e-9f47-a22edab0c492 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.509214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c4563-f213-4cde-b3f9-bf33f35d8be2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.540352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.541388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.542085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.542371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.543642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.545185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.552360 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 45/88] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:56.552360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.554844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.555002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.555301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.555594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.636471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.638182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.656009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.676723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac227257-9853-4d0c-835a-217df413a5d3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.717008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.718189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.718476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.718749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.719951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.721720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.723451 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 46/89] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:56.724237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.758452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.774418 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 44/90] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:32:56.775344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:56.850675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0fd76-e6a7-4cd9-9b7a-076a3526d99d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.899995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.900683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.901232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.901488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.904761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b7c6b-4918-4a3a-b11b-320d51ea7d66 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:56.920007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:56.943749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:56.944578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:56.945022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:56.945497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:56.946486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=cf544868838942a889971356face3a45) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:56.946905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:56.948444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:56.954962 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 45/91] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/role_assignments?user.id=cf544868838942a889971356face3a45&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:56.956868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:57.004198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:57.007474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:57.050417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:57.085256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d9ec6-d37b-4280-b426-07ef3ec863ee None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:57.135760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:57.136446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:57.136741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:57.137026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:57.137912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=a725360ad03a444db8a80dca5cc7c54a) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:57.141443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:57.143778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:57.167303 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 46/92] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/role_assignments?user.id=a725360ad03a444db8a80dca5cc7c54a&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:57.168542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:57.172991 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 47/93] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:32:57.178788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:57.242320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:57.397736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099719f-de6e-4f25-be69-403163a20a48 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:57.418150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86df9-9b6e-4958-9aac-21517bcd4b23 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:57.430112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:57.441839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:57.443113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:57.443396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:57.443673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:57.445249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:57.447038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:57.448766 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 48/94] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:32:57 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:57.457977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:57.521888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:57.522782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:57.523073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:57.523359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] PATH_INFO: `/v3/projects/fc61009587e5428d8d8b49ef872d62b1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:57.529890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] RBAC: Authorizing `identity:get_project(project_id=fc61009587e5428d8d8b49ef872d62b1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:57.531379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:57.533280 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 47/95] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:32:57 2022] GET /identity/v3/projects/fc61009587e5428d8d8b49ef872d62b1 => generated 312 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:57.539109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:57.568812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cafce0-f9b8-4267-bb29-2e153bc2c889 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:57.624936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:57.625548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:57.625925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:57.626208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:57.627731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] RBAC: Adding query filter params (role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=cf544868838942a889971356face3a45) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:57.628107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:57.629753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac24a8f-5b21-4e0f-be3e-5c10f57d467d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:57.640215 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 49/96] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:32:57 2022] GET /identity/v3/role_assignments?user.id=cf544868838942a889971356face3a45&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:32:57.736690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9765503-38ea-4d8e-b367-51a752485cbc None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:57.763385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:57.785616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:57.786307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:57.786598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:57.786882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:57.787737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=fc61009587e5428d8d8b49ef872d62b1, user.id=cf544868838942a889971356face3a45) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:32:57.788056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:57.789631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc60e3c-9ecc-4ae3-8068-ea4bedbc6299 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:57.796386 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 48/97] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:32:57 2022] GET /identity/v3/role_assignments?user.id=cf544868838942a889971356face3a45&scope.project.id=fc61009587e5428d8d8b49ef872d62b1&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:59.405815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eaca8-70b4-4698-8c34-76a008faaf08 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:59.406382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eaca8-70b4-4698-8c34-76a008faaf08 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:59.406382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eaca8-70b4-4698-8c34-76a008faaf08 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:59.408115 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 50/98] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:32:59.418860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c23ce-8fac-4607-bc19-5683c1c7fde3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:59.419342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c23ce-8fac-4607-bc19-5683c1c7fde3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:59.419420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c23ce-8fac-4607-bc19-5683c1c7fde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:59.438985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8b7c23ce-8fac-4607-bc19-5683c1c7fde3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:59.441492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8b7c23ce-8fac-4607-bc19-5683c1c7fde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:59.526842 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 49/99] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:32:59.562525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48eaca8-70b4-4698-8c34-76a008faaf08 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:59.618492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daefd6f-8ac2-41ad-834d-f555aef125cb None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:59.618783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daefd6f-8ac2-41ad-834d-f555aef125cb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:59.618981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daefd6f-8ac2-41ad-834d-f555aef125cb None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:59.620488 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 50/100] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:32:59.625462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379ca7-f755-4198-a718-674a27775175 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:59.625754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379ca7-f755-4198-a718-674a27775175 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:59.626038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379ca7-f755-4198-a718-674a27775175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:59.651032 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a7379ca7-f755-4198-a718-674a27775175 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:32:59.652240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a7379ca7-f755-4198-a718-674a27775175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:32:59.669546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:59.690488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48eaca8-70b4-4698-8c34-76a008faaf08 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:59.727029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:59.727824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:59.728109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:59.728385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:59.729585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:59.733161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:59.733405 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 51/101] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:32:59.739521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:59.787259 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 51/102] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:32:59.830945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7379ca7-f755-4198-a718-674a27775175 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:32:59.858781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84f63-b7e1-4b7f-bc92-038193ab832f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:32:59.893877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:59.898842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:32:59.899820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:32:59.900749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:32:59.901273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:32:59.901644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:32:59.902627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:32:59.905298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:32:59.944899 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 52/103] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:32:59 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:00.037664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7379ca7-f755-4198-a718-674a27775175 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:00.078606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:00.080001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.080782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.081338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.094582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:00.104588 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:00.105843 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:00.106971 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:00.109424 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 52/104] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:32:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:00.117281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:00.255873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15d54-3dde-4a80-8e3f-8463b64bbf32 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:00.292449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:00.293124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.293427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.293707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.294640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:00.294954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:00.296348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a8d4-dc29-47bd-9005-582601eef793 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:00.305520 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 53/105] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:00.310889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:00.325249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb517186-c9b1-4093-885d-e87706f552c8 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.325640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb517186-c9b1-4093-885d-e87706f552c8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.325927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb517186-c9b1-4093-885d-e87706f552c8 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.329659 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 54/106] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:00.337272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7237d-69eb-4050-9e0e-548aa1d6cdbd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.337272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7237d-69eb-4050-9e0e-548aa1d6cdbd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.337272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7237d-69eb-4050-9e0e-548aa1d6cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.361698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-2cf7237d-69eb-4050-9e0e-548aa1d6cdbd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:00.363170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-2cf7237d-69eb-4050-9e0e-548aa1d6cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:00.421511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:00.456121 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 55/107] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:00.461055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:00.462192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591715-df44-4f28-8a3c-9dcf235fcfc6 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.462400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591715-df44-4f28-8a3c-9dcf235fcfc6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.462688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591715-df44-4f28-8a3c-9dcf235fcfc6 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.464340 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 56/108] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:00.470309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.470617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.470986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.489474 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd43e3c-4b57-4898-b2c5-6e20cc940a6f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:00.494987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:00.496199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:00.536630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:00.537884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.538399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.538870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] PATH_INFO: `/v3/users/a71f9a02b9594948a0afac9aa29ae9e2` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.560321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] RBAC: Authorizing `identity:get_user(user_id=a71f9a02b9594948a0afac9aa29ae9e2)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:00.562702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:00.565451 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 53/109] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:00 2022] GET /identity/v3/users/a71f9a02b9594948a0afac9aa29ae9e2 => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:00.566927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:00.575068 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 57/110] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:00.575948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:00.693251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6352-1055-4238-b360-c517c5d41ffc None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:00.703788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:00.709462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eea3c-a9fb-4b55-966d-aeb2dfc9d095 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:00.740688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:00.742192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.742631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.742984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] PATH_INFO: `/v3/roles/member` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.746269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:00.747133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.747609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.748126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.755886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:00.765788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:00.766622 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:00.767592 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:00.774163 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 54/111] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:00.774163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:00.789381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:00.894020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43567-88c2-4b3a-b1de-56f364fcd4df None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:00.895346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:00.897047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:00.934248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:00.935555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:00.935985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:00.936422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:00.949410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:00.959419 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:00.960342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:00.961075 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:00.963534 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 55/112] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:00.964923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.047975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.084946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2eb91-a137-4804-b05f-0ff870c2bcf4 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.128686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.129960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.130768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.131518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.132636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:01.133182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.135421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.136525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.147128 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 56/113] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.151594 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 58/114] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:01.151594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.160641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.286289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bb5cf-6653-4734-9f52-0292a67f6a7b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.303184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504dec1-f580-499c-aa63-05eb6c927ac7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.323060 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.323517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.323808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.324089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.324848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:01.325173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.326626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.342791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.347613 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 59/115] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.348504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.353007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b00c3-fd1b-4216-88ca-f5db1d656489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.355089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b00c3-fd1b-4216-88ca-f5db1d656489 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.355523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b00c3-fd1b-4216-88ca-f5db1d656489 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.355952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b00c3-fd1b-4216-88ca-f5db1d656489 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.357626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b00c3-fd1b-4216-88ca-f5db1d656489 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.359214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b00c3-fd1b-4216-88ca-f5db1d656489 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.362285 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 57/116] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:01.368471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09329d9-ae3e-4b93-b79b-7c7ad7077673 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.368471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09329d9-ae3e-4b93-b79b-7c7ad7077673 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.368471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09329d9-ae3e-4b93-b79b-7c7ad7077673 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.370625 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 58/117] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:01.371239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09329d9-ae3e-4b93-b79b-7c7ad7077673 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.424051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.465715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71502e6-c39a-440a-bcf6-e28a408f7c0b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.494558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09329d9-ae3e-4b93-b79b-7c7ad7077673 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.505030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.505929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.506519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.506802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.508285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.510326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.517365 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 60/118] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.517365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.531666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daacd2-61df-4a05-beeb-ef9929099b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.532620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daacd2-61df-4a05-beeb-ef9929099b45 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.533553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daacd2-61df-4a05-beeb-ef9929099b45 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.535086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daacd2-61df-4a05-beeb-ef9929099b45 None admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.535942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daacd2-61df-4a05-beeb-ef9929099b45 None admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.537427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daacd2-61df-4a05-beeb-ef9929099b45 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.539198 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 59/119] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.540405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e657a-64ce-43b3-b59a-cbc2b1605da7 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.540698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e657a-64ce-43b3-b59a-cbc2b1605da7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.540975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e657a-64ce-43b3-b59a-cbc2b1605da7 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.545206 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 60/120] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:01.545206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.545206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.545206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.563468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:01.565113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:01.630116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.630286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25820980-c3c1-4276-b2e7-40f542684bb0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.636633 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 61/121] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:01.637393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.670643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.679668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.680541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.680822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.681103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.682994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.684459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.686335 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 61/122] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.686947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.749300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aed46-4743-436f-9a89-13731fca3518 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.789540 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.790205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.790493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.790773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.791668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] RBAC: Adding query filter params (role.id=d3fc6d1309574f3f9a331b731457f92f, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=a71f9a02b9594948a0afac9aa29ae9e2) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:01.791985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.792084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb3b2-f752-4b2b-96be-62cfd040cd42 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:01.793494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9327a-de43-4233-9cb0-bf51300e4b52 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.800912 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 62/123] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/role_assignments?user.id=a71f9a02b9594948a0afac9aa29ae9e2&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=d3fc6d1309574f3f9a331b731457f92f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.807697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.808270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.808699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.835278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:01.836469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:01.837049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:01.839070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:01.839070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:01.839070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:01.840246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:01.842000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:01.844362 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 62/124] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:01.846097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.925430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.938983 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 63/125] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:01.945331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:01.946312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:01.997324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3baca8-89b6-4414-9915-0dcb0b0d279c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.045261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.046085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.046376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.046658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.060970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:02.073013 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:02.073908 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:02.074629 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 63/126] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:02.075256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7e669-1a1e-469f-9302-fc55db5a232a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.075327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.112754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.113601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.113987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.114270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/cf544868838942a889971356face3a45/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.116352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39b4a0e688043b99489aaa38b5ea663, user_id=cf544868838942a889971356face3a45, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:02.118034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:02.141394 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 64/127] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:01 2022] PUT /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/cf544868838942a889971356face3a45/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:02.143568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.192601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c20f5f-610b-4f0b-8cf5-5264fb8e7058 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.222768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:02.232255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.233190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.233495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.233809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/a725360ad03a444db8a80dca5cc7c54a/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.236248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39b4a0e688043b99489aaa38b5ea663, user_id=a725360ad03a444db8a80dca5cc7c54a, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:02.237843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:02.263839 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 64/128] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:02 2022] PUT /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/a725360ad03a444db8a80dca5cc7c54a/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:02.264478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.264978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:02.385989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3fe4d-9719-4f2d-b176-201dfebb0593 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.448390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.449168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.449464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.449745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.451672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7936794-0a34-4830-99b9-150647d82c06 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.465309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:02.474342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:02.475258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:02.476020 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 65/129] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:02.485712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.504385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.505534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.506031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.506510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.507616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:02.508239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:02.509980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:02.520072 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 65/130] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:02.526526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.589589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:02.654377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6639-79f1-4b9e-8384-99e96b746ddc None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.654655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d6c8-e784-43b7-b836-57879e3acf41 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.676961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:02.717974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.718921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:02.719854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.720491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.720989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.722081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:02.723065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:02.723598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:02.724086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:02.725733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:02.726227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:02.729134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:02.730853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:02.733879 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 66/131] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:02 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:02.740079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.751121 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 66/132] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:02.759606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:02.951198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639cee7-855d-42e6-be15-ff492dc87365 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:02.967132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16855fa1-62df-4540-af78-d99eeb703c6b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:03.000712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:03.024737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.025707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.025995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.026320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.031406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.033967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:03.035676 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 67/133] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:02 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:03.041817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:03.044106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d74f-af64-40f2-a92b-1781c165595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.044982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d74f-af64-40f2-a92b-1781c165595b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.045293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d74f-af64-40f2-a92b-1781c165595b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.045574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d74f-af64-40f2-a92b-1781c165595b None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.046839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411d74f-af64-40f2-a92b-1781c165595b None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.048673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411d74f-af64-40f2-a92b-1781c165595b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:03.050582 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 67/134] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:02 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:03.057990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb994b-b7b4-4aa6-9c53-8b86e6d9954f None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.058287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb994b-b7b4-4aa6-9c53-8b86e6d9954f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.058573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb994b-b7b4-4aa6-9c53-8b86e6d9954f None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.060171 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 68/135] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:03.065100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb994b-b7b4-4aa6-9c53-8b86e6d9954f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:03.133113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:03.219620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbc439-5265-4b8d-9922-37150de311c5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:03.262564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef756a-b25d-42e3-823e-f7fb24bfb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.263435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef756a-b25d-42e3-823e-f7fb24bfb896 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.263724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef756a-b25d-42e3-823e-f7fb24bfb896 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.264008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef756a-b25d-42e3-823e-f7fb24bfb896 None admin] PATH_INFO: `/v3/projects/fc61009587e5428d8d8b49ef872d62b1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.267747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef756a-b25d-42e3-823e-f7fb24bfb896 None admin] RBAC: Authorizing `identity:get_project(project_id=fc61009587e5428d8d8b49ef872d62b1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.271622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef756a-b25d-42e3-823e-f7fb24bfb896 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:03.276115 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 68/136] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:03 2022] GET /identity/v3/projects/fc61009587e5428d8d8b49ef872d62b1 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:03.277186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.277485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.277766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.290764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb994b-b7b4-4aa6-9c53-8b86e6d9954f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:03.322330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:03.323906 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:03.336657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.337964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.349029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.349647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/cf544868838942a889971356face3a45/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.355818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39b4a0e688043b99489aaa38b5ea663, user_id=cf544868838942a889971356face3a45, role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.357824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:03.380115 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 69/137] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:03 2022] PUT /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/cf544868838942a889971356face3a45/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:03.381293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:03.463301 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 69/138] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:03.472784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:03.509831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:03.562365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f7778-343c-4890-9a58-7a6bf9e99798 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:03.610530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:03.627636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.628541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.629171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.629458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] PATH_INFO: `/v3/projects/fc61009587e5428d8d8b49ef872d62b1/users/cf544868838942a889971356face3a45/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.631495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] RBAC: Authorizing `identity:create_grant(project_id=fc61009587e5428d8d8b49ef872d62b1, user_id=cf544868838942a889971356face3a45, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.633095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:03.666607 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 70/139] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:03 2022] PUT /identity/v3/projects/fc61009587e5428d8d8b49ef872d62b1/users/cf544868838942a889971356face3a45/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:03.733880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22735-9b7b-4d72-96f8-a3c5ba82cba0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:03.786806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0fb0e-58f8-45a0-8ecf-8e909fdaa443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.787633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0fb0e-58f8-45a0-8ecf-8e909fdaa443 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.787917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0fb0e-58f8-45a0-8ecf-8e909fdaa443 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.788192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0fb0e-58f8-45a0-8ecf-8e909fdaa443 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.794150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0fb0e-58f8-45a0-8ecf-8e909fdaa443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.795656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0fb0e-58f8-45a0-8ecf-8e909fdaa443 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:03.797636 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 70/140] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:03.803469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:03.944035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b048ce-1273-4147-b003-56bf3662e06a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:03.946836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:03.985600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fa430-7f30-4f01-898d-78bf2c110170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:03.986360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa430-7f30-4f01-898d-78bf2c110170 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:03.986657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa430-7f30-4f01-898d-78bf2c110170 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:03.986940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa430-7f30-4f01-898d-78bf2c110170 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:03.987698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fa430-7f30-4f01-898d-78bf2c110170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:03.989202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fa430-7f30-4f01-898d-78bf2c110170 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:04.028648 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 71/141] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:03 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:04.661923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5fcad-7d6c-419c-94cd-9a842ce24cf0 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:04.662256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5fcad-7d6c-419c-94cd-9a842ce24cf0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:04.662429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5fcad-7d6c-419c-94cd-9a842ce24cf0 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:04.664426 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 71/142] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:04.670002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:04.670459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:04.670634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:04.694286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:04.695501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:04.784562 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 72/143] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:04.830690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5fcad-7d6c-419c-94cd-9a842ce24cf0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:04.957189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5fcad-7d6c-419c-94cd-9a842ce24cf0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:04.972637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:05.001854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:05.002749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.003034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.003311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.015964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:05.024462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:05.026276 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:05.027857 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 72/144] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:05.032515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:05.134835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:05.147011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ec7c-189d-4b0c-9266-ce5b9d689c31 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:05.191566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:05.192252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.192537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.192811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.193602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:05.193908 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:05.195388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:05.206219 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 73/145] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:05.211493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:05.331684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe782-18a6-4456-b8d3-f5da3c12f866 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:05.373866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa4505-23bc-4ce8-8d0b-be3762c75b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:05.374755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4505-23bc-4ce8-8d0b-be3762c75b40 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.375034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4505-23bc-4ce8-8d0b-be3762c75b40 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.375311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4505-23bc-4ce8-8d0b-be3762c75b40 None admin] PATH_INFO: `/v3/users/a71f9a02b9594948a0afac9aa29ae9e2` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.377113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa4505-23bc-4ce8-8d0b-be3762c75b40 None admin] RBAC: Authorizing `identity:get_user(user_id=a71f9a02b9594948a0afac9aa29ae9e2)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:05.378635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa4505-23bc-4ce8-8d0b-be3762c75b40 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:05.380430 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 73/146] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:05 2022] GET /identity/v3/users/a71f9a02b9594948a0afac9aa29ae9e2 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:05.386837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:05.472605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc3ec-7b0c-4810-9c34-50b1eff25643 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.472900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc3ec-7b0c-4810-9c34-50b1eff25643 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.473086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc3ec-7b0c-4810-9c34-50b1eff25643 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.474639 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 74/147] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:05.480969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.481566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.481849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.516288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:05.519486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:05.554311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:05.558496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04dcf3-c454-4c46-ba67-9823823719e2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:05.601922 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 75/148] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:05.622325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:05.623599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.624084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.624578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.626161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:05.628471 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:05.630760 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 74/149] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:05 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:05.636624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:05.642323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:05.695525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:05.767981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75bd87-acd7-4e08-8079-643948eedab7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:05.808458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:05.809875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.810363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.810844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/a71f9a02b9594948a0afac9aa29ae9e2/roles/d3fc6d1309574f3f9a331b731457f92f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.813721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39b4a0e688043b99489aaa38b5ea663, user_id=a71f9a02b9594948a0afac9aa29ae9e2, role_id=d3fc6d1309574f3f9a331b731457f92f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:05.816479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:05.841733 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 76/150] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:05 2022] PUT /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663/users/a71f9a02b9594948a0afac9aa29ae9e2/roles/d3fc6d1309574f3f9a331b731457f92f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:05.869740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a31ee-def0-48e9-aca7-cb76fc695c6f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:05.925332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:05.926162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:05.926443 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:05.926780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:05.943684 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:05.952139 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:05.953132 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:05.953914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:05.957267 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 75/151] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:05.960234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:06.005376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.103017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e81be-0ef8-4b91-9cee-22de09a5f118 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:06.149002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:06.149710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:06.149994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:06.150268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:06.151031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:06.151342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:06.152726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76789522-0083-476b-bd4d-881dec22c2a5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:06.165671 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 77/152] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:06.171179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:06.197791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bffd-daf0-4db4-9032-1c2b931d7094 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:06.198085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bffd-daf0-4db4-9032-1c2b931d7094 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:06.198359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bffd-daf0-4db4-9032-1c2b931d7094 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:06.199988 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 78/153] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:06.206968 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:06.207266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:06.207590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:06.239583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:06.240779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:06.341508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.386525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a609d-acf5-4c80-9619-f12b9394ddde None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:06.396706 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 79/154] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:06.434595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:06.457362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:06.458242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:06.458524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:06.458887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:06.460246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:06.467282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:06.469014 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 76/155] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:06 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:06.470587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.476473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:06.642825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7129cd-c904-490e-9009-39c6bb428371 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:06.651771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c67c0d-7223-42ee-87f9-7cd95b901da2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:06.712874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:06.714600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:06.715096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:06.715592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:06.725871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:06.726912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:06.727341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:06.727759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:06.747001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.753740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:06.766183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:06.767233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:06.768053 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:06.770668 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 80/156] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:06.777100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:06.820421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:06.822186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:06.951508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:06.989306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3853a0-1cd2-41e0-9234-0bea67e4b7e5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.006347 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 77/157] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:07.014979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.049592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.050464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.050749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.051028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.051791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:07.052103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.053522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.063144 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 81/158] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:07.069947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.131230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.215933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16ae4-9928-4d52-a75e-6217e4f1afbb None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.254337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.255456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.255924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.256340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] PATH_INFO: `/v3/users/a725360ad03a444db8a80dca5cc7c54a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.257747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] RBAC: Authorizing `identity:get_user(user_id=a725360ad03a444db8a80dca5cc7c54a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.259467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.264470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13139f7b-42fc-4e44-a546-85a6fbd8aa55 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.264793 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 82/159] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/users/a725360ad03a444db8a80dca5cc7c54a => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:07.268344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.280409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.310009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.310255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.310535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.310806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.312013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.313524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.315976 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 78/160] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:07.321489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.387062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb396-9ce4-46eb-adae-8d6a7f3c249a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.426031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.426955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.427392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.427818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.428390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca821a5-6dc5-4931-bc49-77460a4b8279 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.445631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.464497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.465169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.465588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.465725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.466630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=cf544868838942a889971356face3a45) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:07.466867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.468322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e814a-ba07-4a93-b816-cda1e986b7d6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.475180 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 79/161] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/role_assignments?user.id=cf544868838942a889971356face3a45&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:07.511036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.512809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.524610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.604168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99dc6-dee1-4801-a9c4-6ce49134273e None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.604449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99dc6-dee1-4801-a9c4-6ce49134273e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.604727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99dc6-dee1-4801-a9c4-6ce49134273e None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.608914 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 80/162] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:07.617360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.617641 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.617918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.636843 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 83/163] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:33:07.642970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.647914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.649111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.756062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887703-ef95-4c2a-b2dc-26e0184d0bef None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.759573 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 81/164] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:07.767461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.797217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.798724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.799282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.799727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.799954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.801160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.802754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.804602 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 84/165] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:07.815920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.999588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a040c-dfbb-4418-82e6-691b603e3b76 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.003448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c624be-3a43-45c2-8a5c-9909a22798a9 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.025298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.063383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.064411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.064706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.064991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.066097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=a725360ad03a444db8a80dca5cc7c54a) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.066429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.067880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.069655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0e2cb-d5f1-42f7-9427-430929aa5d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.070993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e2cb-d5f1-42f7-9427-430929aa5d52 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.072095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e2cb-d5f1-42f7-9427-430929aa5d52 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.072547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e2cb-d5f1-42f7-9427-430929aa5d52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.075327 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 85/166] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/role_assignments?user.id=a725360ad03a444db8a80dca5cc7c54a&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.101546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0e2cb-d5f1-42f7-9427-430929aa5d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-3ba0e2cb-d5f1-42f7-9427-430929aa5d52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:08.109937 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:08.111497 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:08.112622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:08.114695 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 82/167] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:08.121357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.123376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc769-ca16-4972-bcf2-580ecbf59ad5 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.124193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc769-ca16-4972-bcf2-580ecbf59ad5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.124608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc769-ca16-4972-bcf2-580ecbf59ad5 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.126399 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 83/168] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:08.146043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.146734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.147154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.177122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.179117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.212350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.316663 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 84/169] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:08.345854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568f2f-977e-45e9-933f-3e7a395b89ec None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.360029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.432636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.433363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.433653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.433935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.434710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.435021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.436916 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.452853 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 86/170] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.466234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.518036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.522667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850ebc9-8ee0-4986-b523-8dad31834658 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.576868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.577649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.577938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.578219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.594211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:08.602910 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:08.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:08.604658 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 85/171] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:08.612642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.666781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec59af-d26b-4032-b9e9-3b3a81a77f67 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.677258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.712580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.713550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.713838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.714120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.715373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.716843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.722939 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 87/172] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.730103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.745463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97deb01-30b7-4c71-baec-590db996f2d5 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.802221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.803129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.803422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.803706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.804480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.804795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.806271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.823676 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:08.830093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.872988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.873507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413917e-5f2f-4005-b7cb-d2a74167fd8c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.958910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.959575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.959863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.960152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.036778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f386-2f44-497a-be3a-62f14b15e13a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.053202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.103850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.104649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.104928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.105229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] PATH_INFO: `/v3/users/cf544868838942a889971356face3a45` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.109872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] RBAC: Authorizing `identity:get_user(user_id=cf544868838942a889971356face3a45)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.111395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.117164 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 87/174] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/users/cf544868838942a889971356face3a45 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:09.118498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.120171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.123786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.297535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.305659 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 88/175] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:09.310380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca9c88-c03a-4ca8-a6d2-d19971750068 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.315236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.409004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.415080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3f53-c2f7-4537-aa8c-210389f2d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.415828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3f53-c2f7-4537-aa8c-210389f2d9bf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.416116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3f53-c2f7-4537-aa8c-210389f2d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.416400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3f53-c2f7-4537-aa8c-210389f2d9bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.449220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275e517-1e1b-455c-8bda-f5574a672780 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.492209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af4316-5a98-4b32-990e-cbd097c88b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.493864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af4316-5a98-4b32-990e-cbd097c88b8d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.494148 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af4316-5a98-4b32-990e-cbd097c88b8d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.494428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af4316-5a98-4b32-990e-cbd097c88b8d None admin] PATH_INFO: `/v3/projects/fc61009587e5428d8d8b49ef872d62b1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.498123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af4316-5a98-4b32-990e-cbd097c88b8d None admin] RBAC: Authorizing `identity:get_project(project_id=fc61009587e5428d8d8b49ef872d62b1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.499609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af4316-5a98-4b32-990e-cbd097c88b8d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.503150 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 89/176] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/projects/fc61009587e5428d8d8b49ef872d62b1 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:09.504529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf374e-f8df-4d31-95dc-4d7bee0596cb None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.504848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf374e-f8df-4d31-95dc-4d7bee0596cb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.505128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf374e-f8df-4d31-95dc-4d7bee0596cb None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.510685 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 90/177] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:09.513075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf374e-f8df-4d31-95dc-4d7bee0596cb None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.576536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa3f53-c2f7-4537-aa8c-210389f2d9bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.578062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa3f53-c2f7-4537-aa8c-210389f2d9bf None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.730855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf374e-f8df-4d31-95dc-4d7bee0596cb None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.742468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.756945 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 88/178] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:09.762753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc9d6-4315-44c1-b111-fa8d6949cd8b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.762753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc9d6-4315-44c1-b111-fa8d6949cd8b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.762753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc9d6-4315-44c1-b111-fa8d6949cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.781579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.782178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c33fc9d6-4315-44c1-b111-fa8d6949cd8b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:09.783306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.783764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.784182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.784534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c33fc9d6-4315-44c1-b111-fa8d6949cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:09.785350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=fc61009587e5428d8d8b49ef872d62b1, user.id=cf544868838942a889971356face3a45) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:09.785805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.788593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36e601-6dd5-446f-b458-af3e2c99da77 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.801250 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 91/179] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/role_assignments?user.id=cf544868838942a889971356face3a45&scope.project.id=fc61009587e5428d8d8b49ef872d62b1&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:09.802792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a547-d65c-4ae6-8c78-b5c0759215d2 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.803088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a547-d65c-4ae6-8c78-b5c0759215d2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.803371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a547-d65c-4ae6-8c78-b5c0759215d2 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.804759 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 92/180] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:09.805524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a547-d65c-4ae6-8c78-b5c0759215d2 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.820999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.917046 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 89/181] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:09.919444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166782-8065-47df-a6c9-3067e7914155 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.919980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166782-8065-47df-a6c9-3067e7914155 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.920534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166782-8065-47df-a6c9-3067e7914155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.941390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0c166782-8065-47df-a6c9-3067e7914155 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:09.943078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0c166782-8065-47df-a6c9-3067e7914155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:09.959550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a547-d65c-4ae6-8c78-b5c0759215d2 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.998758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dbc70-fcef-4de2-820d-7adaa11cbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.999604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dbc70-fcef-4de2-820d-7adaa11cbdfc None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.999891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dbc70-fcef-4de2-820d-7adaa11cbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.000221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dbc70-fcef-4de2-820d-7adaa11cbdfc None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.001703 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dbc70-fcef-4de2-820d-7adaa11cbdfc None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.003332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dbc70-fcef-4de2-820d-7adaa11cbdfc None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.005638 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 93/182] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:10.009526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecfd93-7296-45e4-aa9a-966900a690cb None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.009526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecfd93-7296-45e4-aa9a-966900a690cb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.009526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecfd93-7296-45e4-aa9a-966900a690cb None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.009526 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 94/183] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:10.014257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecfd93-7296-45e4-aa9a-966900a690cb None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.036739 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 90/184] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:10.038515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.039019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.039503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.057287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:10.058789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:10.108724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.123483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.146233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecfd93-7296-45e4-aa9a-966900a690cb None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.146434 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 91/185] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:10.146882 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.187248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.188041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.188323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.188715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.200052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:10.208094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:10.209171 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:10.210146 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 95/186] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:10.210889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.255312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddc1f7-f826-4171-906c-624ab267a730 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.288809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.289486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.289762 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.290034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.290858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] RBAC: Adding query filter params (role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=cf544868838942a889971356face3a45) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:10.291165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.292632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdfe7a-079b-4e73-b3e0-d0dcf4978090 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.299024 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 92/187] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/role_assignments?user.id=cf544868838942a889971356face3a45&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:10.301009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968294e9-b2ff-44a4-b6f3-96e8109688b8 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.301659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968294e9-b2ff-44a4-b6f3-96e8109688b8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.301963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968294e9-b2ff-44a4-b6f3-96e8109688b8 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.304410 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 93/188] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:10.304410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968294e9-b2ff-44a4-b6f3-96e8109688b8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.312733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdc7a-c380-4746-b1f4-be8fb3e87499 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.348234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.355907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.357023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.357345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.357628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.366636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.370554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:10.379790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:10.380744 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 96/189] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:10.387106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.437133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968294e9-b2ff-44a4-b6f3-96e8109688b8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.474834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f5157-f63a-4299-8611-184580e2fb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.475634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f5157-f63a-4299-8611-184580e2fb2a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.475918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f5157-f63a-4299-8611-184580e2fb2a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.476197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f5157-f63a-4299-8611-184580e2fb2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.477430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f5157-f63a-4299-8611-184580e2fb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.478934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f5157-f63a-4299-8611-184580e2fb2a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.480580 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 94/190] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:10.482036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.482325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.482603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.501418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:10.502668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0340-b5ed-4349-b1f0-b34dd6cd2d57 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.502803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:10.543435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.544136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.544427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.545428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.546200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:10.546517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.547908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.556785 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 97/191] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:10.557661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.580974 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 95/192] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:10.581842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.613655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.625712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.662549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59ddc-07f1-4adb-b940-e1be83f9a79b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.681608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d6800-f79b-41e1-88d7-b5dc0b04cec6 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.696010 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.696681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.696967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.697292 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.698040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:10.698352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.699732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.707872 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 98/193] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:10.708671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.720840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.721546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.721829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.722108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.722869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.724340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.744265 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 96/194] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:10.745280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.828416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083edcd9-02c9-4fc0-9756-6d96e208d2f1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.846690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.869076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.871585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.872869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.873171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.873497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] PATH_INFO: `/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.873668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ee72-f6ab-4923-b361-92a4fdc15c1d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.890212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=15d3ca8e4c434c74824bd56c2e24b6fa)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.891695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.898650 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 99/195] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:10.898650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.921529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.922335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.922620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.922895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.936090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:10.944414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:10.945603 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 97/196] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:10.946414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.028368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d4c9-7f89-4670-a766-0be05fa99cf7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.074250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.075151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.075438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.075734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] PATH_INFO: `/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.076957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] RBAC: Authorizing `identity:get_user(user_id=15d3ca8e4c434c74824bd56c2e24b6fa)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.078561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.081285 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 100/197] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:11.085278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.091281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55a8c7-bf84-49f2-bdc0-ddf984de996c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.134147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.134147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.134440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.134653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.138626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.175616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.216174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b61ebc-6abe-450a-9d4a-f7affb6d749f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.225820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.228016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.258814 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5741836-0817-4296-b647-fe69247580ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.259733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741836-0817-4296-b647-fe69247580ee None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.260184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741836-0817-4296-b647-fe69247580ee None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.260624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741836-0817-4296-b647-fe69247580ee None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.261737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5741836-0817-4296-b647-fe69247580ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:11.262195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5741836-0817-4296-b647-fe69247580ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.263728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5741836-0817-4296-b647-fe69247580ee None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.273078 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 101/198] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:11.274254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5741836-0817-4296-b647-fe69247580ee None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.346961 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 98/199] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:11.347916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.385207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5741836-0817-4296-b647-fe69247580ee None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.393560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.409882 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.426429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.427571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.428062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.428541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.453485 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5cdc8-59ea-46d7-bcb0-6933451e2736 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.491554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.492778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.493231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.493588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] PATH_INFO: `/v3/users/a71f9a02b9594948a0afac9aa29ae9e2` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.494909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] RBAC: Authorizing `identity:get_user(user_id=a71f9a02b9594948a0afac9aa29ae9e2)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.496469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.498294 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 99/200] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/users/a71f9a02b9594948a0afac9aa29ae9e2 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:11.499138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.512817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.514342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.641635 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 102/201] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:11.643738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.646316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b956-c975-4aad-9eaa-ce1c9e689880 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.649701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.680649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.695175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.696390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.696871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.697350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.698768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.700520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.702437 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 100/202] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:11.703368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.769436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f31a54-c8d8-4236-846b-745af8616b1d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.808329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.809290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.809783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.810274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.819737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e39dd-b812-4c5e-8986-e442f61ecc52 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.854908 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.856179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.856816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.856816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.858102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.859627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.862260 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 101/203] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:11.863166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.890805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.893479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.895646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.926444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.967227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdeb46-033d-4f55-bea7-24144bc50fc7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.005099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.005895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.006247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.006598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.007584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=15d3ca8e4c434c74824bd56c2e24b6fa) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:12.007867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.009437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.015227 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 102/204] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/role_assignments?user.id=15d3ca8e4c434c74824bd56c2e24b6fa&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:12.016220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.023294 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 103/205] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:12.029266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.128285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a61e-7a2b-4edb-b9d0-9e84b457554b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.152611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc028-3935-4690-a17f-4d73be763772 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.155431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:12.158316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:12.168308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.169078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.169459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.169805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.170724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] RBAC: Adding query filter params (role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=15d3ca8e4c434c74824bd56c2e24b6fa) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:12.171116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.172704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.179545 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 103/206] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/role_assignments?user.id=15d3ca8e4c434c74824bd56c2e24b6fa&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:12.208969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049530c-30d0-4d67-8835-11256c87d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.210369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049530c-30d0-4d67-8835-11256c87d867 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.210863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049530c-30d0-4d67-8835-11256c87d867 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.211319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049530c-30d0-4d67-8835-11256c87d867 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.212924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049530c-30d0-4d67-8835-11256c87d867 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.214834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049530c-30d0-4d67-8835-11256c87d867 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.217320 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 104/207] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:12.225405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.377626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a188-9125-4c5c-88a5-74d5b1ef9497 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.421050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f82716-73c4-4b77-b082-26134053729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.421671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82716-73c4-4b77-b082-26134053729d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.421954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82716-73c4-4b77-b082-26134053729d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.422235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82716-73c4-4b77-b082-26134053729d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.423115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82716-73c4-4b77-b082-26134053729d None admin] RBAC: Adding query filter params (role.id=d3fc6d1309574f3f9a331b731457f92f, scope.project.id=d39b4a0e688043b99489aaa38b5ea663, user.id=a71f9a02b9594948a0afac9aa29ae9e2) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:12.423428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82716-73c4-4b77-b082-26134053729d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.424889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82716-73c4-4b77-b082-26134053729d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.431374 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 104/208] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/role_assignments?user.id=a71f9a02b9594948a0afac9aa29ae9e2&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=d3fc6d1309574f3f9a331b731457f92f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:13.312561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce871-56a1-430b-91d2-d3c8dcc01877 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.313075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce871-56a1-430b-91d2-d3c8dcc01877 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.313181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce871-56a1-430b-91d2-d3c8dcc01877 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.315271 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 105/209] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:13.320558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.320955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.321116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.343824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:13.345414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:13.345574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab670d-d78d-469c-bf35-2b2b462f2c8e None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.345872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab670d-d78d-469c-bf35-2b2b462f2c8e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.346151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab670d-d78d-469c-bf35-2b2b462f2c8e None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.347790 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 106/210] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:13.354173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.354796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.355276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.373990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:13.375473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:13.409608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:13.433840 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 105/211] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:13.460347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.462893 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 107/212] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:13.487777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.574788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503a53-01d1-4cb6-b9fa-c92e1e23376b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.594160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:13.598232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81249c-bdfd-40b9-878f-583d5bb44899 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.615728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.616624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.616914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.617212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.618478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.620012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.622146 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 106/213] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:13.627523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.640401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.641542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.642269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.642957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.654426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:13.664219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:13.665071 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:13.665864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:13.668479 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 108/214] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:13.674296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.683363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:13.735701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e866a8-c7ae-4177-a13f-fa96c16a268d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.773642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.774317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.774602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.774881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.775606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.777199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.790182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8425d29-c481-46e5-889f-786e108df500 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.800639 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 107/215] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:13 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:13.830506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.831444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.831932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.832348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.833351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:13.833924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.835484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.846821 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 109/216] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:13.857182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.973909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb265cd-50e4-490e-b3ab-b3225fdb00ea None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.988759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:14.020441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.021353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.021630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.021901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] PATH_INFO: `/v3/users/b2fd5a48960d455a9380bfd8d0722afd` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.037869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd5a48960d455a9380bfd8d0722afd)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:14.039357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:14.041434 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 108/217] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/users/b2fd5a48960d455a9380bfd8d0722afd => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:14.048675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.077201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:14.164492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b203c-f41e-453e-965f-e362a7c87e38 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:14.201932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe45a23-06af-4b14-9765-5fb54f3ae975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.202600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45a23-06af-4b14-9765-5fb54f3ae975 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.202883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45a23-06af-4b14-9765-5fb54f3ae975 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.203162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45a23-06af-4b14-9765-5fb54f3ae975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.283711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe45a23-06af-4b14-9765-5fb54f3ae975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:14.285689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe45a23-06af-4b14-9765-5fb54f3ae975 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:14.314275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:14.402658 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 110/218] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:14.409704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.511284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df239a-eae0-4fb8-8358-27ee8819596f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.511609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df239a-eae0-4fb8-8358-27ee8819596f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.511849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df239a-eae0-4fb8-8358-27ee8819596f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.513246 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 111/219] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:14.518678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.518972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.519253 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.549494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b62a66-e6bf-48f5-a57b-fe88a0efda92 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:14.562216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:14.563559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:14.589488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.590436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.590719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.591035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.593169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:14.595565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:14.598584 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 109/220] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:14.609172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.671962 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 112/221] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:14.696626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.713509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:14.759647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:14.819078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb96205-34a2-442d-a10c-9dbd094d0214 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:14.832089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f184b-969d-40b3-94ea-0a0afa08166f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:14.858060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.859135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.859591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.860037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.870926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.871586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.871869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.872145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.873121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=b2fd5a48960d455a9380bfd8d0722afd) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:14.873383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:14.874326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:14.874837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1688-33a6-40ed-bb6b-d6db0dcd9f62 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:14.887765 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 110/222] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/role_assignments?user.id=b2fd5a48960d455a9380bfd8d0722afd&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:14.887765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa581-eab8-4a32-852a-cfabb5f964a5 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.887765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa581-eab8-4a32-852a-cfabb5f964a5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.887765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa581-eab8-4a32-852a-cfabb5f964a5 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.887765 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 111/223] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:14.888191 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:14.888954 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:14.889737 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 113/224] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:14.898310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.898701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.899079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.903021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.934472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:14.935703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:15.074434 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 112/225] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:15.085652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20589-4054-488b-8737-59e0db72682a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.103570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.124723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.136212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.136950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.137312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.137600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.138459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:15.138778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.140179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.150575 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 114/226] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:15.156319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.157064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.254978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd001-fa8c-4995-ac60-c3e12d093e5a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.298914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.299733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.300011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.300781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.317166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:15.322341 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:15.323392 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:15.324354 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:15.333802 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 113/227] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:15.335212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.362597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef578f-125e-45d3-9210-022491214ff9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.453575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.457915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b1baf-bbe2-4cf7-97fa-dc4a17d421e7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.473557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.474595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.474980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.475360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] PATH_INFO: `/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.476668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] RBAC: Authorizing `identity:get_user(user_id=15d3ca8e4c434c74824bd56c2e24b6fa)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.478370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.487631 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 115/228] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:15.493461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.495620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.496611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.496972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.497282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.498096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:15.498405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.499852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.515458 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 114/229] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:15.517404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.583439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.642089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99a6b6-f3b1-4af8-adcb-ec96977340dd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.679148 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc994c-5c07-4b06-964f-9c6f6bc46be1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.680407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.681317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.681597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.681870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] PATH_INFO: `/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.683095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] RBAC: Authorizing `identity:get_user(user_id=15d3ca8e4c434c74824bd56c2e24b6fa)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.684561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.689283 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 115/230] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:15.694243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.734588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.736775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.737952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.738558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.740168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.741597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.743482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.746169 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 116/231] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:15.757165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.837118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4f0f-fe58-41e7-bfbd-641271d8d137 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.873056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.874013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.874408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.874699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.877013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.878590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.880903 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 116/232] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:15.886520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.923200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11639f9-dbd9-4704-b6ff-6d3396da8149 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.950779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.960327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497014-5e34-4ad7-abe5-83a430584997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.961322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497014-5e34-4ad7-abe5-83a430584997 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.961614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497014-5e34-4ad7-abe5-83a430584997 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.961893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497014-5e34-4ad7-abe5-83a430584997 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/15d3ca8e4c434c74824bd56c2e24b6fa/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.965932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de497014-5e34-4ad7-abe5-83a430584997 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5280780ca34f3186e3a4cbeea7a396, user_id=15d3ca8e4c434c74824bd56c2e24b6fa, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.967380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de497014-5e34-4ad7-abe5-83a430584997 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:16.005931 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 117/233] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:15 2022] PUT /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/15d3ca8e4c434c74824bd56c2e24b6fa/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:16.061923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:16.085577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5fc1-973a-44b5-84bf-2440223a5f0d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:16.136784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39886aa8-59fd-4182-ae33-34083ce639ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:16.137931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886aa8-59fd-4182-ae33-34083ce639ea None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.138382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886aa8-59fd-4182-ae33-34083ce639ea None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.138829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39886aa8-59fd-4182-ae33-34083ce639ea None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/15d3ca8e4c434c74824bd56c2e24b6fa/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.142620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39886aa8-59fd-4182-ae33-34083ce639ea None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5280780ca34f3186e3a4cbeea7a396, user_id=15d3ca8e4c434c74824bd56c2e24b6fa, role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:16.144293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39886aa8-59fd-4182-ae33-34083ce639ea None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:16.171618 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 117/234] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:15 2022] PUT /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/15d3ca8e4c434c74824bd56c2e24b6fa/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:16.432175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef200d-acfc-42b3-a056-693f6a037399 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.432696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef200d-acfc-42b3-a056-693f6a037399 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.432800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef200d-acfc-42b3-a056-693f6a037399 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.434164 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 118/235] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:16.440155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.440475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.440714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.464094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:16.465347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:16.557133 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 118/236] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:16.581133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef200d-acfc-42b3-a056-693f6a037399 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:16.750787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef200d-acfc-42b3-a056-693f6a037399 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:16.799887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6d5a-7a77-4cf8-85ca-dbfe1c93fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:16.800693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6d5a-7a77-4cf8-85ca-dbfe1c93fc27 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.800978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6d5a-7a77-4cf8-85ca-dbfe1c93fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.801288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6d5a-7a77-4cf8-85ca-dbfe1c93fc27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.816360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6d5a-7a77-4cf8-85ca-dbfe1c93fc27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-276d6d5a-7a77-4cf8-85ca-dbfe1c93fc27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:16.824174 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:16.825026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:16.826250 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 119/237] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:16.831600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:16.846993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a399-6ae1-43bc-b4d1-1a172e764849 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.847306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a399-6ae1-43bc-b4d1-1a172e764849 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.847558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a399-6ae1-43bc-b4d1-1a172e764849 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.849242 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 120/238] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:16.855487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.855775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.856313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.883933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:16.885162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:16.943679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:16.961596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:17.006643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c637a-7b47-411e-ba57-62b511370a29 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:17.015658 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 121/239] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:17.050293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:17.051318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.051820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.052384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.053398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:17.053926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:17.055521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:17.061697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:17.073770 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 119/240] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:17.079825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:17.240880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9ee5-d5d1-45a8-904e-cc444bdd0d6a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:17.242309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be909-2a95-4d27-883d-38b79465b844 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:17.283244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:17.284037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.284317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.284594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] PATH_INFO: `/v3/users/44ef59b0b98c4f29a7e09645b207c4f0` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.295926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:17.308249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] RBAC: Authorizing `identity:get_user(user_id=44ef59b0b98c4f29a7e09645b207c4f0)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:17.309774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:17.312571 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 120/241] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:17 2022] GET /identity/v3/users/44ef59b0b98c4f29a7e09645b207c4f0 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:17.320138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:17.321026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.321537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.321857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.323237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:17.324231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:17.326193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:17.337187 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 122/242] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:17.338027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:17.389705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:17.518109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcfc7f-7fa2-49d4-911a-4456ed86e995 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:17.541259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5297562-0138-4cc2-a5ad-c33820324513 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:17.591897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:17.592543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.592818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.593094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.616482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82ee1-bfec-4e34-9982-cb6d02c57673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:17.617199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82ee1-bfec-4e34-9982-cb6d02c57673 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.617491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82ee1-bfec-4e34-9982-cb6d02c57673 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.617771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82ee1-bfec-4e34-9982-cb6d02c57673 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.618500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82ee1-bfec-4e34-9982-cb6d02c57673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:17.619950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82ee1-bfec-4e34-9982-cb6d02c57673 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:17.668079 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 123/243] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:17 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:17.668712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:17.674114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:17.676034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:17.725372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7569-40aa-4d93-9cc0-b23a7aaf511a None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.726072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7569-40aa-4d93-9cc0-b23a7aaf511a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.726574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7569-40aa-4d93-9cc0-b23a7aaf511a None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.728310 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 124/244] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:17.734417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:17.735172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:17.735693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:17.754095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:17.755831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:17.792535 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 121/245] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:17.798361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:17.872275 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 125/246] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:17.919718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:17.946863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:17.963711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:17.972585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e182d-2c80-48fd-9368-a504712e560e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.061689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.064077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.064564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.065043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.065922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a36d9-d17c-4bd2-a562-31f5b99c550e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.067025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.070037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.072352 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 122/247] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:17 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:18.077693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.111455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.112257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.112547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.113165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] PATH_INFO: `/v3/roles/member` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.135774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:18.144304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:18.145259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:18.146039 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:18.147680 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 126/248] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:18.153212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.233899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94145-ca83-47cc-a097-34e58f4ecbc1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.259413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:18.277765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.278542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.278898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.279270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.280374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] RBAC: Adding query filter params (role.id=d3fc6d1309574f3f9a331b731457f92f, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=44ef59b0b98c4f29a7e09645b207c4f0) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:18.280484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.282745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.289554 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 123/249] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:18 2022] GET /identity/v3/role_assignments?user.id=44ef59b0b98c4f29a7e09645b207c4f0&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=d3fc6d1309574f3f9a331b731457f92f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:18.298685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82164-5dc2-4544-a4e0-e6484563f71f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.353496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.354440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.354871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.355296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.356497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:18.356955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.358545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.369898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 127/250] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:18.376369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.411248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:18.499815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe387f87-ff77-4f3d-8e99-3dc897bb10c7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.539396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.540955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.541436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.541858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] PATH_INFO: `/v3/users/b2fd5a48960d455a9380bfd8d0722afd` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.543223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd5a48960d455a9380bfd8d0722afd)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.544936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.547097 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 124/251] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:18 2022] GET /identity/v3/users/b2fd5a48960d455a9380bfd8d0722afd => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:18.553046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.670025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbf636-75be-4a44-94c4-d654d20e2632 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.718115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231020-0c06-4682-85ed-db75509eb164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.719277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231020-0c06-4682-85ed-db75509eb164 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.719786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231020-0c06-4682-85ed-db75509eb164 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.720354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231020-0c06-4682-85ed-db75509eb164 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.721762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231020-0c06-4682-85ed-db75509eb164 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.723401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231020-0c06-4682-85ed-db75509eb164 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.729433 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 128/252] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:18 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:18.736127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.846864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:18.853992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5da6-fb9c-4d25-b4fa-5ea19c40191b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.888629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783107-ed9b-4a5d-a46a-5f89180f9694 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.889606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783107-ed9b-4a5d-a46a-5f89180f9694 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.890092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8783107-ed9b-4a5d-a46a-5f89180f9694 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.895949 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 129/253] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:18.898441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24366f6-7545-4a43-9190-3148d5cfc0ee None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.899141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24366f6-7545-4a43-9190-3148d5cfc0ee None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.899739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24366f6-7545-4a43-9190-3148d5cfc0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.900215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.901106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.901551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.901831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/b2fd5a48960d455a9380bfd8d0722afd/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.906434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5280780ca34f3186e3a4cbeea7a396, user_id=b2fd5a48960d455a9380bfd8d0722afd, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.908417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:18.908623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.929966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c24366f6-7545-4a43-9190-3148d5cfc0ee None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:18.934240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c24366f6-7545-4a43-9190-3148d5cfc0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:18.939634 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 125/254] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:18 2022] PUT /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/b2fd5a48960d455a9380bfd8d0722afd/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:19.044272 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 130/255] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:19.087290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:19.229319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f04048-7bdb-417d-9e08-7f4c113ea379 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:19.249083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbdbb3-56ac-47c0-8d09-4d01bce4b47c None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:19.249438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbdbb3-56ac-47c0-8d09-4d01bce4b47c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:19.249662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbdbb3-56ac-47c0-8d09-4d01bce4b47c None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:19.251356 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 131/256] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:19.257796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:19.257796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:19.257796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:19.292079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:19.293343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:19.293834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:19.294307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:19.298414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:19.299594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:19.312085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:19.330773 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:19.331714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:19.332495 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:19.336434 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 126/257] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:19.350521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:19.377127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:19.466627 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 132/258] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:19.500044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a9b3-191b-4fc7-ada4-a80400f2a553 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:19.508462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:19.548719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:19.549410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:19.549664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:19.549941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:19.550691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:19.550997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:19.552384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:19.567846 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 127/259] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:19.585819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:19.624671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:19.699398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:19.702286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080fcc-c040-4ba9-8b38-d2def60af4f8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:19.736968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9ddc-798c-40c5-bcf2-0c5d9c4228e5 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:19.793239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:19.794013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:19.794297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:19.794680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:19.803416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:19.804385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:19.804692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:19.805028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] PATH_INFO: `/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:19.809911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] RBAC: Authorizing `identity:get_user(user_id=15d3ca8e4c434c74824bd56c2e24b6fa)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:19.811405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:19.814095 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 128/260] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:19 2022] GET /identity/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:19.817104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:19.833687 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:19.834597 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:19.835380 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 133/261] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:19.838382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:19.842345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:19.999005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381e47-acf7-4621-b944-a447a8ddb253 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.063062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.064268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.064551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.064834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.079455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7aaa-fe65-40e8-9b07-d3d9b5f2c7a9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.093652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.129272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.152966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.153662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.153943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.154213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.155022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:20.155329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.156768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.176298 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 134/262] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:20.181750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:20.182184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.183665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.318400 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 129/263] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:20.324405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:20.380448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.412943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6783-d87a-491d-adaa-a7ff6380e552 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.445335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2b6a-a130-4574-ae43-4e6ae91db7dd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.476449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.477505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.478089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.478208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] PATH_INFO: `/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.479512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] RBAC: Authorizing `identity:get_user(user_id=15d3ca8e4c434c74824bd56c2e24b6fa)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.485182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.488218 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 135/264] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:20 2022] GET /identity/v3/users/15d3ca8e4c434c74824bd56c2e24b6fa => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:20.489780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:20.494425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.495484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.495938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.496360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.501983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.503619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.505578 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 130/265] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:20 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:20.511326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:20.553044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.604214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6ebb4-53f1-4fd4-a1e2-5ea4a6b9a352 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.640976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.641965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f37597-dd21-47d3-a06a-26016851a2e6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.643205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.643686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.644199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.657243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.680108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.680776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.681057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.681382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.682201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=15d3ca8e4c434c74824bd56c2e24b6fa) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:20.682516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.683990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.690679 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 131/266] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:20 2022] GET /identity/v3/role_assignments?user.id=15d3ca8e4c434c74824bd56c2e24b6fa&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:20.725270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.727134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.792568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.852623 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 136/267] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:20.854524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.016268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44737cd-bbe7-422c-9fcf-7561f302ba63 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:21.066906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c697-41bf-442e-9710-c97dfabda3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:21.067768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c697-41bf-442e-9710-c97dfabda3fe None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.068047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c697-41bf-442e-9710-c97dfabda3fe None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.068325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c697-41bf-442e-9710-c97dfabda3fe None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.073888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977c697-41bf-442e-9710-c97dfabda3fe None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:21.075377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977c697-41bf-442e-9710-c97dfabda3fe None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:21.077120 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 132/268] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:20 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:21.083858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.229831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af407f-d9b7-4c83-b4b5-ab8a82db7873 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.230201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af407f-d9b7-4c83-b4b5-ab8a82db7873 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.230376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af407f-d9b7-4c83-b4b5-ab8a82db7873 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.232274 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 133/269] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:21.242322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.242631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.242870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.254482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32bf6-5103-4f82-bcc8-c724a39b51af None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:21.278382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:21.279626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:21.305879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:21.306563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.306908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.307190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.308096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] RBAC: Adding query filter params (role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=15d3ca8e4c434c74824bd56c2e24b6fa) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:21.308418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:21.309906 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:21.317285 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 137/270] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:21 2022] GET /identity/v3/role_assignments?user.id=15d3ca8e4c434c74824bd56c2e24b6fa&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:21.337892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:21.374410 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 134/271] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:21.418250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.450700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:21.575113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26979-9f5b-4e0c-8f77-8b8116e0633b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:21.630324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2bcad-a898-4f6f-9853-9637b06b9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:21.631371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2bcad-a898-4f6f-9853-9637b06b9644 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.631818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2bcad-a898-4f6f-9853-9637b06b9644 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.632238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2bcad-a898-4f6f-9853-9637b06b9644 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.649105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2bcad-a898-4f6f-9853-9637b06b9644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-dfe2bcad-a898-4f6f-9853-9637b06b9644 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:21.658219 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:21.659322 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:21.660266 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:21.668158 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 138/272] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:21.670047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.784265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49d61-9fd1-42d4-8bdf-720c1346f49e None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.784914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49d61-9fd1-42d4-8bdf-720c1346f49e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.785446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa49d61-9fd1-42d4-8bdf-720c1346f49e None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.787300 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 139/273] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:21.793197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cb8c3-d31d-41e6-8548-dced0037512e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.793800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cb8c3-d31d-41e6-8548-dced0037512e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.794276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cb8c3-d31d-41e6-8548-dced0037512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.823246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ed5cb8c3-d31d-41e6-8548-dced0037512e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:21.824293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93d85a-ed3b-460c-8f18-a9de2aaa7d99 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:21.825035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ed5cb8c3-d31d-41e6-8548-dced0037512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:21.862720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:21.863318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.863599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.863875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.864623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] RBAC: Adding query filter params (name=reader) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:21.864919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:21.866431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e831ec-ede4-4075-87b7-274efbae679c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:21.876497 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 135/274] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:21.878644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4858-1a66-40ac-8c86-bff4a556a2cc None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.879094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4858-1a66-40ac-8c86-bff4a556a2cc None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.879526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4858-1a66-40ac-8c86-bff4a556a2cc None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.884752 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 136/275] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:21.884752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f4858-1a66-40ac-8c86-bff4a556a2cc None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.908515 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 140/276] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:21.910027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.910323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.910606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.928161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:21.929611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:21.930631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:21.932809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.004115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f4858-1a66-40ac-8c86-bff4a556a2cc None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.004839 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 141/277] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:22.010060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.042735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.043608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.043889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.044160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] PATH_INFO: `/v3/users/44ef59b0b98c4f29a7e09645b207c4f0` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.045398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] RBAC: Authorizing `identity:get_user(user_id=44ef59b0b98c4f29a7e09645b207c4f0)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.046839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.048720 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 137/278] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:21 2022] GET /identity/v3/users/44ef59b0b98c4f29a7e09645b207c4f0 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:22.052942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.132187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb624-effd-45ec-8fb9-14a7aa0b35a4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.165011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1e229-399a-4b6c-b85b-e579026b985c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.171114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.171933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.172220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.172530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.173941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.174207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.175725 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.177631 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 142/279] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:22.178548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.189889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.210765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.211632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.211918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.212197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.223476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:22.231673 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:22.232570 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:22.233360 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 138/280] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:22.234033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.298072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f10f-d634-4f03-a01f-9b56eab672a7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.338378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.339266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.342124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.342124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.342791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.344322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.346368 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 143/281] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:22.347000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.356216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f52bf-e346-4d1e-8c69-f435f2119d49 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.390416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.391093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.391432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.391743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.392473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.394019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.415770 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 139/282] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:22 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:22.416578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.435885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.447245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.466606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1b8f-4d83-4954-b373-4d959369c6ae None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.508041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.508724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.509007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.509317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.510082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:22.510394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.511812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16bd44-814b-4a23-9dce-3f28d5d72e77 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.526500 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 144/283] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:22.526500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5e24-9e41-4f79-a8b4-af0f5312b732 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.526500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5e24-9e41-4f79-a8b4-af0f5312b732 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.526500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5e24-9e41-4f79-a8b4-af0f5312b732 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.526500 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 145/284] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:22.527493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5e24-9e41-4f79-a8b4-af0f5312b732 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.549395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b956eb-9ea0-4185-af59-a8ff6f5cafc0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.589210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7d24-348b-4d9e-a6ac-9727b128578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.590119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7d24-348b-4d9e-a6ac-9727b128578b None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.590402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7d24-348b-4d9e-a6ac-9727b128578b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.590678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7d24-348b-4d9e-a6ac-9727b128578b None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/44ef59b0b98c4f29a7e09645b207c4f0/roles/d3fc6d1309574f3f9a331b731457f92f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.592748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc7d24-348b-4d9e-a6ac-9727b128578b None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5280780ca34f3186e3a4cbeea7a396, user_id=44ef59b0b98c4f29a7e09645b207c4f0, role_id=d3fc6d1309574f3f9a331b731457f92f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.594265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc7d24-348b-4d9e-a6ac-9727b128578b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.611270 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 140/285] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:33:22 2022] PUT /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/users/44ef59b0b98c4f29a7e09645b207c4f0/roles/d3fc6d1309574f3f9a331b731457f92f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:22.618914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.618914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.619327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.639052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:22.639614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.665285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5e24-9e41-4f79-a8b4-af0f5312b732 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.722402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.723480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.723902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.724285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] PATH_INFO: `/v3/users/de60131df50649f098104d1bcda3a542` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.728456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.746683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] RBAC: Authorizing `identity:get_user(user_id=de60131df50649f098104d1bcda3a542)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.748938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.755442 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 146/286] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/users/de60131df50649f098104d1bcda3a542 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:22.756839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.757925 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 141/287] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:22.785955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.808059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.887818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb36ba1-03b8-4dff-95e2-7e986b6f0b94 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.927098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905dcea-e7fa-4ea7-834e-f3062b8d852e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.927375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.927989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.928274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.928664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.929648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, user.id=de60131df50649f098104d1bcda3a542, scope.system=all) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:22.929959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.931410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.938191 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 147/288] 10.222.0.45 () {56 vars in 1308 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/role_assignments?user.id=de60131df50649f098104d1bcda3a542&scope.system=all&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:22.969955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.970823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.971104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.971380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.983559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:22.992319 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:22.993303 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:22.994067 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 142/289] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:22.999909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.089248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:23.147855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a109a0-a14a-4f4f-b0ae-4da7808be19d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.193617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.194208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.194490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.194768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.195529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:23.195839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.197244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:23.211048 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 148/290] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:23.216375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.301880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:23.346268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ae49e-f8d9-40a6-b8f5-0f3544a20a87 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.398840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.400121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.400604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.401078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] PATH_INFO: `/v3/users/b2fd5a48960d455a9380bfd8d0722afd` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.404511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd5a48960d455a9380bfd8d0722afd)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.406284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:23.408704 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 143/291] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:23 2022] GET /identity/v3/users/b2fd5a48960d455a9380bfd8d0722afd => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:23.415094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.584517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474c99-d23e-41e2-90f6-b0d9c0ae4b0f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.607629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:23.622181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.623501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.623793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.624193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.694992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.696459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:23.797273 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:23.803202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.981774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee732-e701-4f9f-bb8e-5ef892e694fc None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:24.027200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b378b1-f278-4469-9265-b3f2e00cd3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:24.028482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b378b1-f278-4469-9265-b3f2e00cd3c0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.028758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b378b1-f278-4469-9265-b3f2e00cd3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.029046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b378b1-f278-4469-9265-b3f2e00cd3c0 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.030679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b378b1-f278-4469-9265-b3f2e00cd3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:24.032905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b378b1-f278-4469-9265-b3f2e00cd3c0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:24.035243 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 144/293] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:23 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:24.042672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:24.075431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:24.181822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f3cf3-05ee-4356-aa64-29b1345e37a9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:24.228975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:24.229741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.230088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.230369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.231459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=b2fd5a48960d455a9380bfd8d0722afd) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:24.231767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:24.233339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86dd4-f3b4-446d-a5c7-961e9c009241 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:24.240536 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 150/294] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:24 2022] GET /identity/v3/role_assignments?user.id=b2fd5a48960d455a9380bfd8d0722afd&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:25.181361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705715c-4001-44b3-9719-a17e7172b824 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.181889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705715c-4001-44b3-9719-a17e7172b824 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.181966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705715c-4001-44b3-9719-a17e7172b824 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.183552 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 145/295] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:25.189202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.189611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.189777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.208004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:25.209226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:25.218070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e4db-3ad9-4179-afdf-37661fc3d35c None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.218356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e4db-3ad9-4179-afdf-37661fc3d35c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.218634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e4db-3ad9-4179-afdf-37661fc3d35c None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.220349 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 146/296] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:25.225610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.225894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.226175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.244122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:25.245837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:25.248311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.298782 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 151/297] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:25.321623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.340734 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 147/298] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:25.349770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.369178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.450455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713395-2f3e-47de-98a3-bf5615901668 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.481958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d7263-fff0-4c3c-8ec6-7a619528f13f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.499309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.501255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.502136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.502641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.518638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:25.521759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40426c29-37de-4f19-99d7-4ab9ecb6e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.522794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426c29-37de-4f19-99d7-4ab9ecb6e529 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.523284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426c29-37de-4f19-99d7-4ab9ecb6e529 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.523777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426c29-37de-4f19-99d7-4ab9ecb6e529 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:25.526545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:25.527395 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:25.528313 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 152/299] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:25.534565 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.536509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.541293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40426c29-37de-4f19-99d7-4ab9ecb6e529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-40426c29-37de-4f19-99d7-4ab9ecb6e529 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:25.549596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:25.550656 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:25.551598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:25.553244 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 148/300] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:25.554699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489568-1b67-40a1-96de-a526a85d4669 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.554982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489568-1b67-40a1-96de-a526a85d4669 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.555262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489568-1b67-40a1-96de-a526a85d4669 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.556549 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 149/301] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:25.557740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6489568-1b67-40a1-96de-a526a85d4669 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.633389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.660331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01726efd-242c-4c25-86c7-1ae3a668e0c9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.673656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6489568-1b67-40a1-96de-a526a85d4669 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.698816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.699562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.700011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.700113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.700840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:25.701395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.702505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7945d-92e7-43db-ae48-7f742607dcf3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.711508 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 153/302] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:25.712718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.712867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.713066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.713411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.713510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.713694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.713967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.714717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:25.715030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.716463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.726324 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 150/303] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:25.727130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.737874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:25.739271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:25.794169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.808498 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 154/304] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:25.809378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.835901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b666b1-3995-42df-926f-137cb5099924 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.871427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aa361-576d-4f80-b4f5-b331811d705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.872278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa361-576d-4f80-b4f5-b331811d705f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.872578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa361-576d-4f80-b4f5-b331811d705f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.872855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa361-576d-4f80-b4f5-b331811d705f None admin] PATH_INFO: `/v3/users/44ef59b0b98c4f29a7e09645b207c4f0` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.874143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aa361-576d-4f80-b4f5-b331811d705f None admin] RBAC: Authorizing `identity:get_user(user_id=44ef59b0b98c4f29a7e09645b207c4f0)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.875488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.875596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aa361-576d-4f80-b4f5-b331811d705f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.877561 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 151/305] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/users/44ef59b0b98c4f29a7e09645b207c4f0 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:25.878755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e4f74-d043-4333-b359-e8bae7f3fc6f None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.879034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e4f74-d043-4333-b359-e8bae7f3fc6f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.879308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e4f74-d043-4333-b359-e8bae7f3fc6f None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.880526 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 152/306] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:25.881286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e4f74-d043-4333-b359-e8bae7f3fc6f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.913999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408f6f-ce60-426e-8015-0a13de7a42fc None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.948646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.949575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.950266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.950266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] PATH_INFO: `/v3/users/fbb4afab54504eaf8ede4735d68dd45a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.963938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] RBAC: Authorizing `identity:get_user(user_id=fbb4afab54504eaf8ede4735d68dd45a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.965419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.967098 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 155/307] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/users/fbb4afab54504eaf8ede4735d68dd45a => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:25.967873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.988180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e4f74-d043-4333-b359-e8bae7f3fc6f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.014308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.024295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f000a8-8db9-4d05-8b3a-6848958a65cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.025090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f000a8-8db9-4d05-8b3a-6848958a65cf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.025407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f000a8-8db9-4d05-8b3a-6848958a65cf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.025690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f000a8-8db9-4d05-8b3a-6848958a65cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.027196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f000a8-8db9-4d05-8b3a-6848958a65cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.028858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f000a8-8db9-4d05-8b3a-6848958a65cf None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.030818 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 153/308] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:26.032624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.032963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.033299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.049637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:26.050819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:26.083367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c464f5-d73d-41b3-a969-9c3f008ee734 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.110520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.121429 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 154/309] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:26.121585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.122116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.122216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.122425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.122671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.191580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.193039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.234040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db643c44-8436-4118-ac1c-65a8526cfadf None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.260343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.272833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.273500 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.273780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.274053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.274875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] RBAC: Adding query filter params (role.id=d3fc6d1309574f3f9a331b731457f92f, user.id=fbb4afab54504eaf8ede4735d68dd45a, scope.system=all) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:26.275187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.276616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.281566 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 155/310] 10.222.0.45 () {56 vars in 1308 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/role_assignments?user.id=fbb4afab54504eaf8ede4735d68dd45a&scope.system=all&role.id=d3fc6d1309574f3f9a331b731457f92f => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:26.283235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.291685 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 156/311] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:26.292580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.320427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.411037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748556-30df-4a5a-a876-328d5a61d0e4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.411785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc512d59-316f-4bb2-b781-b62a48a5914d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.449498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.450177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.450455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.450727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] PATH_INFO: `/v3/groups` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.451417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.452889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.454849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.455932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.456408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.456827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.468999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:26.471504 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 156/312] 10.222.0.45 () {60 vars in 1134 bytes} [Mon May 23 12:33:26 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:26.472345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:26.478752 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:26.479693 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:26.481531 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 157/313] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:26.487132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.546424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.610042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d385-e257-4d59-a76d-fece030cdcbe None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.618204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.643895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f787-53e7-440c-9d86-c27b9fe8c337 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.652505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.653592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.653969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.654349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.655706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.657861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.659751 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 157/314] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:26.665506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.689396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.690082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.690372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.690656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.691896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:26.692213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.693648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.702967 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 158/315] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:26.709374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.799110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1f9a-4838-4d33-9b27-758a6aa3a237 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.821917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.827099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141888a-a59c-4b52-8ad0-202aef13d156 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.841292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.842342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.842853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.843321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.844433 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] RBAC: Adding query filter params (role.id=d3fc6d1309574f3f9a331b731457f92f, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396, user.id=44ef59b0b98c4f29a7e09645b207c4f0) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:26.845077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.846697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.857571 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 158/316] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/role_assignments?user.id=44ef59b0b98c4f29a7e09645b207c4f0&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=d3fc6d1309574f3f9a331b731457f92f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:26.870967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1102773-e160-4cf6-b6bb-d7786082d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.871864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1102773-e160-4cf6-b6bb-d7786082d406 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.872149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1102773-e160-4cf6-b6bb-d7786082d406 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.872428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1102773-e160-4cf6-b6bb-d7786082d406 None admin] PATH_INFO: `/v3/users/de60131df50649f098104d1bcda3a542` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.873972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1102773-e160-4cf6-b6bb-d7786082d406 None admin] RBAC: Authorizing `identity:get_user(user_id=de60131df50649f098104d1bcda3a542)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.876162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1102773-e160-4cf6-b6bb-d7786082d406 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.878860 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 159/317] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/users/de60131df50649f098104d1bcda3a542 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:26.884288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:27.001984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0ac2f-0be4-4b67-a67b-980d1950dd1a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:27.042227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb48a5-f709-4c9e-a39c-5bf17d70096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:27.043151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb48a5-f709-4c9e-a39c-5bf17d70096d None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.043427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb48a5-f709-4c9e-a39c-5bf17d70096d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.043698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb48a5-f709-4c9e-a39c-5bf17d70096d None admin] PATH_INFO: `/v3/system/users/de60131df50649f098104d1bcda3a542/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.046628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb48a5-f709-4c9e-a39c-5bf17d70096d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de60131df50649f098104d1bcda3a542, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:27.046628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb48a5-f709-4c9e-a39c-5bf17d70096d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:27.057415 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 159/318] 10.222.0.45 () {58 vars in 1334 bytes} [Mon May 23 12:33:26 2022] PUT /identity/v3/system/users/de60131df50649f098104d1bcda3a542/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:28.661435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eea6c7-2ec4-4a68-9131-548170353353 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.661946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eea6c7-2ec4-4a68-9131-548170353353 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.662021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eea6c7-2ec4-4a68-9131-548170353353 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.663448 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 160/319] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:28.669099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75989c-9db9-43e9-b8a6-515c36f33f0b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.669571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75989c-9db9-43e9-b8a6-515c36f33f0b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.669666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75989c-9db9-43e9-b8a6-515c36f33f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.687967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5d75989c-9db9-43e9-b8a6-515c36f33f0b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:28.689575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5d75989c-9db9-43e9-b8a6-515c36f33f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:28.734585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:28.764806 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 160/320] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:28.787868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eea6c7-2ec4-4a68-9131-548170353353 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.805381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:28.826584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e2e0-91e4-4664-a813-2b8156181c59 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.826995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e2e0-91e4-4664-a813-2b8156181c59 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.827396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e2e0-91e4-4664-a813-2b8156181c59 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.830093 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 161/321] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:28.835514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.835898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.836274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.857915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:28.859530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:28.901292 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eea6c7-2ec4-4a68-9131-548170353353 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:28.937239 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 162/322] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:28.937583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:28.938630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.939054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.939336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.949784 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:28.955411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:28.958338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:28.959233 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:28.961412 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 161/323] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:28.965366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.045417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:29.065354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3c24-c946-47d5-b697-9aa951d62008 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.072787 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:29.076152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eb9df-d4de-4d65-b6d6-f0646c802026 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.103274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.104081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.104362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.104636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.106175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.107693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.114548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.115097 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 163/324] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:29.115550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.115836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.115946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.116117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.116905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:29.117252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.118910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.130608 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 162/325] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:29.135343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.234612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c11d-bc78-4c73-9329-f407127e7d09 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.249981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c007a1-3745-4c20-99a1-e9c5284f6ae9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.271417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeffbb-c210-45b0-8a8d-0b93bedb5cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.272086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeffbb-c210-45b0-8a8d-0b93bedb5cbd None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.272369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeffbb-c210-45b0-8a8d-0b93bedb5cbd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.272644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeffbb-c210-45b0-8a8d-0b93bedb5cbd None admin] PATH_INFO: `/v3/groups` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.273379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeffbb-c210-45b0-8a8d-0b93bedb5cbd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.274831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeffbb-c210-45b0-8a8d-0b93bedb5cbd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.290257 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 164/326] 10.222.0.45 () {60 vars in 1134 bytes} [Mon May 23 12:33:29 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:29.298423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.299532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.299826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.300107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] PATH_INFO: `/v3/users/fbb4afab54504eaf8ede4735d68dd45a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.301552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fbb4afab54504eaf8ede4735d68dd45a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.303037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.304962 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 163/327] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:29 2022] GET /identity/v3/users/fbb4afab54504eaf8ede4735d68dd45a => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:29.311062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.311712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a382f-a11a-48d4-bd10-f2dfe62630ef None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.312000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a382f-a11a-48d4-bd10-f2dfe62630ef None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.312279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a382f-a11a-48d4-bd10-f2dfe62630ef None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.314500 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 165/328] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:29.319060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:29.320781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.321319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.321690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.340097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:29.341618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:29.378677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:29.427915 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 166/329] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:29.434403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829c04-8fca-4ff9-880a-7d1a8d8e42c1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.452836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.477711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.478591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.478879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.479162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] PATH_INFO: `/v3/system/users/fbb4afab54504eaf8ede4735d68dd45a/roles/d3fc6d1309574f3f9a331b731457f92f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.480970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fbb4afab54504eaf8ede4735d68dd45a, role_id=d3fc6d1309574f3f9a331b731457f92f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.482409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.493982 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 164/330] 10.222.0.45 () {58 vars in 1334 bytes} [Mon May 23 12:33:29 2022] PUT /identity/v3/system/users/fbb4afab54504eaf8ede4735d68dd45a/roles/d3fc6d1309574f3f9a331b731457f92f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:29.574056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c85f-f781-43f9-b73b-52e4863db882 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.618215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.619439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.619945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.620434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.634223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:29.643501 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:29.644422 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:29.645231 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:29.645824 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 167/331] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:29.652235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.738655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:29.781555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32bbf8-506a-4ef2-9bac-e3c1c138c8c9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.823272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.823956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.824236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.824512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.825313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:29.825614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.826997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.837567 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 165/332] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:29.843396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.877079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:29.973434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee04b-18ce-4cf5-9a11-d3b2c7bbcbff None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.012825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47c9f3-3dcf-4491-b288-31d1e243d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.013740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47c9f3-3dcf-4491-b288-31d1e243d783 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.014024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47c9f3-3dcf-4491-b288-31d1e243d783 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.014300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47c9f3-3dcf-4491-b288-31d1e243d783 None admin] PATH_INFO: `/v3/users/de60131df50649f098104d1bcda3a542` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.015617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47c9f3-3dcf-4491-b288-31d1e243d783 None admin] RBAC: Authorizing `identity:get_user(user_id=de60131df50649f098104d1bcda3a542)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.017074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47c9f3-3dcf-4491-b288-31d1e243d783 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.019070 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 168/333] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:29 2022] GET /identity/v3/users/de60131df50649f098104d1bcda3a542 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:30.025279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:30.169896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab39d-8625-4780-b97e-63209f514288 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.208079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:30.217053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.217843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.218138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.218424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.219305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] RBAC: Adding query filter params (role.id=7c75c0d6bb084b3389f8d26bebd09b23, user.id=de60131df50649f098104d1bcda3a542, scope.system=all) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:30.219624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.221269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d9de6-745c-4993-81b1-e326d45279a8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.236400 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 166/334] 10.222.0.45 () {56 vars in 1308 bytes} [Mon May 23 12:33:30 2022] GET /identity/v3/role_assignments?user.id=de60131df50649f098104d1bcda3a542&scope.system=all&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:32.087397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931be163-3914-43b5-9536-ae26d41c5001 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.087938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931be163-3914-43b5-9536-ae26d41c5001 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.087938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931be163-3914-43b5-9536-ae26d41c5001 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.089627 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 169/335] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:32.096065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33ec0-f240-48f5-afe3-c05a3d683ee9 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.096511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33ec0-f240-48f5-afe3-c05a3d683ee9 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.096701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33ec0-f240-48f5-afe3-c05a3d683ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.118165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8ce33ec0-f240-48f5-afe3-c05a3d683ee9 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:32.119366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8ce33ec0-f240-48f5-afe3-c05a3d683ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:32.200216 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 167/336] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:32.223417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b30f6-9b18-4ec4-a800-3bc8327e9e9e None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.223715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b30f6-9b18-4ec4-a800-3bc8327e9e9e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.223975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b30f6-9b18-4ec4-a800-3bc8327e9e9e None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.225562 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 170/337] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:32.231473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16843-da31-4f8d-9d44-7150923f6fc9 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.231758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16843-da31-4f8d-9d44-7150923f6fc9 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.232036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16843-da31-4f8d-9d44-7150923f6fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.234527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742b6c-e35b-47de-a441-f893118daf67 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.234897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742b6c-e35b-47de-a441-f893118daf67 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.235186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742b6c-e35b-47de-a441-f893118daf67 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.236792 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 171/338] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:32.247375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742b6c-e35b-47de-a441-f893118daf67 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:32.253624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-0cc16843-da31-4f8d-9d44-7150923f6fc9 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:32.254807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0cc16843-da31-4f8d-9d44-7150923f6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:32.359518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:32.370681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742b6c-e35b-47de-a441-f893118daf67 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:32.410881 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 168/339] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:32.412381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.412671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:32.412894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.413249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.414026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.414460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.414888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.428207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:32.436952 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:32.438304 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:32.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:32.441739 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 172/340] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:32.449171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:32.449171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:32.450661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:32.573132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:32.579906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5701bc-3661-4415-942a-adb7ebf9e58b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:32.618675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:32.619600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.620040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.620637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.621911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] RBAC: Adding query filter params (name=member) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:32.622389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:32.624106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:32.634426 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 173/341] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:32.635651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:32.653497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:32.658821 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 169/342] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:32.659802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:32.777293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515b09-cd88-4220-a108-b048d26457bb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:32.817512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:32.818714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.819200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.819679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.838334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:32.848062 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:32.848928 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:33:32.849737 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:32.852992 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 174/343] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:32.854179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:32.949596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:32.976084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab830c-2a56-43dc-9f5f-4b2b1d05571f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.014790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.016021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.016509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.017011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.029577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:33.040477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:33.041463 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:33.042255 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:33.042860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428d5b-fb7f-4698-8a29-e7f3bbf62081 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.044961 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 175/344] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:33.051173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:33.159099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.159804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.160042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.160322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.173329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211e99-3d9a-40e6-8ca6-9c36512b2a5b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.213305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694714bb-738f-494c-879a-d35663228832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.214465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694714bb-738f-494c-879a-d35663228832 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.214962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694714bb-738f-494c-879a-d35663228832 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.215447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694714bb-738f-494c-879a-d35663228832 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.216875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694714bb-738f-494c-879a-d35663228832 None admin] RBAC: Adding query filter params (name=reader) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:33.217529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694714bb-738f-494c-879a-d35663228832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:33.219336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694714bb-738f-494c-879a-d35663228832 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:33.221921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:33.233353 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 176/345] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:33.235361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694714bb-738f-494c-879a-d35663228832 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:33.239876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:33.293866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:33.295293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:33.355078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694714bb-738f-494c-879a-d35663228832 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.397269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.398393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.398907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.399388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.400363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:33.400872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:33.402783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:33.412542 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 177/346] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:33.413889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:33.485608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:33.538553 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 170/347] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:33.539442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:33.539828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787c1f-8d22-4d80-9c2a-b0e33bce1fba None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.589313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef50d6-0bf7-420b-82fd-27b014d591c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.592109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef50d6-0bf7-420b-82fd-27b014d591c1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.592628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef50d6-0bf7-420b-82fd-27b014d591c1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.593167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef50d6-0bf7-420b-82fd-27b014d591c1 None admin] PATH_INFO: `/v3/users/fbb4afab54504eaf8ede4735d68dd45a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.595447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef50d6-0bf7-420b-82fd-27b014d591c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fbb4afab54504eaf8ede4735d68dd45a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:33.597692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef50d6-0bf7-420b-82fd-27b014d591c1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:33.600328 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 178/348] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:33:33 2022] GET /identity/v3/users/fbb4afab54504eaf8ede4735d68dd45a => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:33.602425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46d99-1ef6-440c-ae57-6db8a5d83c43 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.602927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46d99-1ef6-440c-ae57-6db8a5d83c43 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.603406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46d99-1ef6-440c-ae57-6db8a5d83c43 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.605930 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 179/349] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:33.607869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46d99-1ef6-440c-ae57-6db8a5d83c43 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:33.636661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:33.661370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbfd0c-646f-4cc0-8d02-c59c57fc3a1d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.708050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7108-9c43-479f-93df-be8eeeecf2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.708721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7108-9c43-479f-93df-be8eeeecf2b6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.709005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7108-9c43-479f-93df-be8eeeecf2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.709316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7108-9c43-479f-93df-be8eeeecf2b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.759249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46d99-1ef6-440c-ae57-6db8a5d83c43 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:33.795774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:33.800157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7108-9c43-479f-93df-be8eeeecf2b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:33.802648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7108-9c43-479f-93df-be8eeeecf2b6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:33.808253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:33.808702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.809056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.809483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.811596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:33.813567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:33.816267 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 180/350] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:33 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:33.817024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:33.904847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:33.934417 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 171/351] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:33.935909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:33.936271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:33.936623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:33.956904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:33.958356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:33.959566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b069-2ff8-4211-98f2-d07f8f4e6284 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.013650 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.014906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.015372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.017006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.018185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] RBAC: Adding query filter params (role.id=d3fc6d1309574f3f9a331b731457f92f, user.id=fbb4afab54504eaf8ede4735d68dd45a, scope.system=all) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:34.018692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.021305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.037922 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 181/352] 10.222.0.45 () {56 vars in 1308 bytes} [Mon May 23 12:33:33 2022] GET /identity/v3/role_assignments?user.id=fbb4afab54504eaf8ede4735d68dd45a&scope.system=all&role.id=d3fc6d1309574f3f9a331b731457f92f => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:34.039179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.059095 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 172/353] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:34.060459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.111407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.178675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1edc-ef98-45c4-87d6-5789d16214db None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.216531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795a56e-90c0-46f7-b6fa-e3a6188425ed None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.227714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.229934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d01ece-0f8e-4a2f-b40c-74e7f6d62b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.231073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d01ece-0f8e-4a2f-b40c-74e7f6d62b4a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.231351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d01ece-0f8e-4a2f-b40c-74e7f6d62b4a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.231621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d01ece-0f8e-4a2f-b40c-74e7f6d62b4a None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.239241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d01ece-0f8e-4a2f-b40c-74e7f6d62b4a None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.240828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d01ece-0f8e-4a2f-b40c-74e7f6d62b4a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.243019 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 182/354] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:34.244435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151988-ed0d-4945-b77f-9ce9c9764a4d None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.244721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151988-ed0d-4945-b77f-9ce9c9764a4d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.245000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151988-ed0d-4945-b77f-9ce9c9764a4d None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.251947 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 183/355] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:34.252431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151988-ed0d-4945-b77f-9ce9c9764a4d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.267672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297bd7d-b3cb-42ec-b0f2-91ab2b2b4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.268901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297bd7d-b3cb-42ec-b0f2-91ab2b2b4af2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.269386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297bd7d-b3cb-42ec-b0f2-91ab2b2b4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.269883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297bd7d-b3cb-42ec-b0f2-91ab2b2b4af2 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.271431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297bd7d-b3cb-42ec-b0f2-91ab2b2b4af2 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.273260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297bd7d-b3cb-42ec-b0f2-91ab2b2b4af2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.279959 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 173/356] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:34.282263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.282554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.282921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.302201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:34.303752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:34.386670 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 174/357] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:34.387534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.393856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151988-ed0d-4945-b77f-9ce9c9764a4d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.415450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.437347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c38c-cda3-4470-9280-a6195fb6195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.440048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c38c-cda3-4470-9280-a6195fb6195e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.440305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c38c-cda3-4470-9280-a6195fb6195e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.440580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c38c-cda3-4470-9280-a6195fb6195e None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.451685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c38c-cda3-4470-9280-a6195fb6195e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-fdc6c38c-cda3-4470-9280-a6195fb6195e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:34.459784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:34.460684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:34.461754 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 184/358] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:34.463141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b5a6-4192-41f7-9e40-04edc6ed55f6 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.463141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b5a6-4192-41f7-9e40-04edc6ed55f6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.463141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b5a6-4192-41f7-9e40-04edc6ed55f6 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.464524 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 185/359] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:34.465074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6b5a6-4192-41f7-9e40-04edc6ed55f6 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.510332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c810b11-b17f-421e-b62a-9d39ec6331f1 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.519621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.552210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.552210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.552527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.552766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.553566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=d39b4a0e688043b99489aaa38b5ea663) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:34.553879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.555633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.563943 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 175/360] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:34.564687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.598970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6b5a6-4192-41f7-9e40-04edc6ed55f6 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.652222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.653105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.653424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.653718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.654923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.656499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.658409 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 186/361] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:34.664399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.712318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb43db-e62a-4b6f-a4ea-18e0d574de44 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.736268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.760827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502456dd-61af-4e60-934b-6ed9e969c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.761707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502456dd-61af-4e60-934b-6ed9e969c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.761988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502456dd-61af-4e60-934b-6ed9e969c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.762266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502456dd-61af-4e60-934b-6ed9e969c3e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.776573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502456dd-61af-4e60-934b-6ed9e969c3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-502456dd-61af-4e60-934b-6ed9e969c3e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:34.787912 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:34.789002 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:34.790017 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:34.794782 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 176/362] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:34.794782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.794782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.794782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.818900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:34.820103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:34.824372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faffcd3-62d3-4557-9566-1e84c1577a39 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.853448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.868613 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.870831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.870831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.870831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.870831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] RBAC: Adding query filter params (name=member) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:34.871144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.872906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.882857 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 187/363] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:34.887879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.920010 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 177/364] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:34.920963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.023672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e0086-b1c1-471a-bcd5-fcba988d169a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.032789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.049169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da456cad-f8ca-4163-bc6a-ccd37ef3c212 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.065842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.066512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.066794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.067072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.067915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=d39b4a0e688043b99489aaa38b5ea663) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:35.068229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.069718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.076795 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 188/365] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:35.076795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.098603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.099352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.099641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.099983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.100932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:35.101317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.102929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.114949 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 178/366] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:35.115904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.153454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.231328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440022b-847b-4aaf-9505-974c7ce3cbec None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.258270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed019b-39e8-40e9-ba69-9ee8bf0e071d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.272051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.273311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.273799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.274271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.298728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.299521 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.299809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.300087 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.312410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:35.323393 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:35.324351 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:35.325633 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 179/367] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:35.326523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.342303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.365053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.366952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.436190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.465408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4fab4-eb05-404a-a843-523cefd5ce6c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.485245 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 189/368] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:35.486502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.506109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.506773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.507063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.507352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.599124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339639-6bdb-4d43-8527-3c0bf8e4820f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.605070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.605825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.606831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.644732 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.645886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.646388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.646865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.647844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:35.648352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.649970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.663081 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 190/369] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:35.664315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.747217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.769171 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 180/370] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:35.770232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.833746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e983d1-f1bb-4ee0-8f2c-b41c14815e3d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.883238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:35.890780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.892058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.892593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.893017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.899211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.900773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.903436 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 191/371] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:35.904622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.941812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191735f1-d06b-4236-a948-7623d79cfe33 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.995951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.996619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.996893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.997204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.079754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.081600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c89a-f0a1-43ee-8408-8c698f4d6888 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.106614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.110503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.137984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.138867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.139154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.139433 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.142461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.144129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.146366 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 192/372] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.147275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.242800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.263383 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 181/373] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:36.264314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.295198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5221-0765-4aa6-9193-55ba08b37b27 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.341297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.344700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.344700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.344700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.344700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.346241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.349894 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 193/374] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.350156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.366812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.386597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cee32-8728-480c-b352-0c91caffb102 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.424610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.425427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.425703 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.425979 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.427339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.428843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.430560 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 182/375] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.431399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.492329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f3c1-78d6-4600-81b8-1cef39745f28 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.539814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.541303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.542301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.542788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] PATH_INFO: `/v3/projects/42a3411808a2449f8a4f73e9a1925a0f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.544394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=42a3411808a2449f8a4f73e9a1925a0f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.544839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533905-cf91-4d5b-b95d-29e0301b1196 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.547159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.550540 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 194/376] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/projects/42a3411808a2449f8a4f73e9a1925a0f => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.552123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.557106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.589193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.589875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.590155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.590487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.591331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:36.591691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.593201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.599580 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 183/377] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.600426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.618628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.716195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e5cb-e458-4550-a82b-14264df20e1d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.727389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e205e2-b09e-426c-8d29-8464d233c0a4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.757173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.757173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.757173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.757173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] PATH_INFO: `/v3/groups/7b1b0e3d2fc74354ac19b17443703430` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.764953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1b0e3d2fc74354ac19b17443703430)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.766695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.768438 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 184/378] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/groups/7b1b0e3d2fc74354ac19b17443703430 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.774527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.790900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.791810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.792232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.792660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.793798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:36.794302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.795887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c61b47-19bf-466a-af99-71175087d6ba None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.808129 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 195/379] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:36.873339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.900511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a842-7a6f-432f-af97-ea0ec35ecc84 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.941520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.941520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.941931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.942077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.942824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] RBAC: Adding query filter params (group.id=7b1b0e3d2fc74354ac19b17443703430, role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=42a3411808a2449f8a4f73e9a1925a0f) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:36.943141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.945230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afa755-e075-44a0-9489-56906d8924fb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.951153 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 185/380] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:36 2022] GET /identity/v3/role_assignments?group.id=7b1b0e3d2fc74354ac19b17443703430&scope.project.id=42a3411808a2449f8a4f73e9a1925a0f&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:37.380771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5114-08b3-433c-a5c5-a911205f98d3 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:37.381300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5114-08b3-433c-a5c5-a911205f98d3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:37.381417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5114-08b3-433c-a5c5-a911205f98d3 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:37.383025 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 196/381] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:37.398841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:37.399343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:37.399581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:37.422859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:37.424143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:37.507899 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 186/382] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:37.540067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5114-08b3-433c-a5c5-a911205f98d3 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:37.632558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:37.710021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5114-08b3-433c-a5c5-a911205f98d3 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:37.755756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:37.756552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:37.756837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:37.757122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:37.771034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:37.778933 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:37.779811 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:37.780596 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 197/383] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:37.790269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:37.895210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:37.933920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d1fca-3da0-4618-afad-207ae0f9f972 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:37.975734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:37.976444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:37.976725 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:37.977012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:37.977817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:37.978127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:37.979510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:37.991589 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 187/384] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:37.997088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.172763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39dcc2-c63b-4699-a315-259def43eb58 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.204136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:38.212419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a08c34-96cb-40fa-9d0e-1f82ad5fb23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.213350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a08c34-96cb-40fa-9d0e-1f82ad5fb23a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.213920 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a08c34-96cb-40fa-9d0e-1f82ad5fb23a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.214212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a08c34-96cb-40fa-9d0e-1f82ad5fb23a None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.215860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a08c34-96cb-40fa-9d0e-1f82ad5fb23a None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.217365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a08c34-96cb-40fa-9d0e-1f82ad5fb23a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:38.219855 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 198/385] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:37 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:38.225431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.278768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74d345-0ae2-4dc1-938e-fe803ffd9fd8 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.279079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74d345-0ae2-4dc1-938e-fe803ffd9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.279337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74d345-0ae2-4dc1-938e-fe803ffd9fd8 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.280720 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 199/386] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:38.286931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.287226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.287507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.306731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:38.307964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:38.384880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105db9-62dc-4f1c-bedc-513c59e5d685 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.449568 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 200/387] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:38.452117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.452991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.453990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.454281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.455656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.457096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:38.459127 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 188/388] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:38 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:38.464355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.494242 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.497262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:38.655036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3819f2-aa0c-47b1-a7f7-4bcb9f7852a3 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.659787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f27ad5-8a96-48e2-8183-44152a5d554f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.709890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:38.726028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.727564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.728580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.730006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663/groups/05f96f50050643a69201867e2409e1f5/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.733090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.734157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.735094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] RBAC: Authorizing `identity:create_grant(project_id=d39b4a0e688043b99489aaa38b5ea663, group_id=05f96f50050643a69201867e2409e1f5, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.735587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.737552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.738331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:38.756802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:38.761640 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 201/389] 10.222.0.45 () {58 vars in 1442 bytes} [Mon May 23 12:33:38 2022] PUT /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663/groups/05f96f50050643a69201867e2409e1f5/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:38.775930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:38.776961 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:38.777819 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:38.780553 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 189/390] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:38.787559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.911115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1bf91-ab47-4468-8eac-eea6f01aa0dd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.957595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.959204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.959751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.960280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.961297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:38.961822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.963411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:38.977943 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 202/391] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:38.984858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:39.062314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:39.123640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9c217-748f-427a-b092-5a09290e640c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:39.170628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:39.171507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.171788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.172793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.174033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:39.175542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:39.177559 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 190/392] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:38 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:39.182931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:39.238461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:39.312406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373618ed-5a81-4d40-8bb8-875cb36cf67a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:39.364248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd059a-c6a5-4de8-b6cd-c29e83a121e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:39.365119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd059a-c6a5-4de8-b6cd-c29e83a121e5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.365425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd059a-c6a5-4de8-b6cd-c29e83a121e5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.365705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd059a-c6a5-4de8-b6cd-c29e83a121e5 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.366928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd059a-c6a5-4de8-b6cd-c29e83a121e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:39.368382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd059a-c6a5-4de8-b6cd-c29e83a121e5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:39.370473 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 203/393] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:39 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:39.376218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:39.517538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce98359-78b4-47ce-80b2-b1ff528e9d1c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:39.548894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:39.555016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344dcf2-714b-4a79-bb6a-63d35d5d1704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:39.556089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dcf2-714b-4a79-bb6a-63d35d5d1704 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.556436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dcf2-714b-4a79-bb6a-63d35d5d1704 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.556895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dcf2-714b-4a79-bb6a-63d35d5d1704 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663/groups/05f96f50050643a69201867e2409e1f5/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.559281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344dcf2-714b-4a79-bb6a-63d35d5d1704 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39b4a0e688043b99489aaa38b5ea663, group_id=05f96f50050643a69201867e2409e1f5, role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:39.560775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344dcf2-714b-4a79-bb6a-63d35d5d1704 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:39.579167 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 191/394] 10.222.0.45 () {58 vars in 1442 bytes} [Mon May 23 12:33:39 2022] PUT /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663/groups/05f96f50050643a69201867e2409e1f5/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:39.763326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062a19-9bf6-43b9-b248-85afc2c54236 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.763861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062a19-9bf6-43b9-b248-85afc2c54236 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.764142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062a19-9bf6-43b9-b248-85afc2c54236 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.766135 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 204/395] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:39.772392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.772743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.773130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.792724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:39.793967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:39.830872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7deaf3-4f0c-41ed-96f7-f103e46a0660 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.831518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7deaf3-4f0c-41ed-96f7-f103e46a0660 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.832010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7deaf3-4f0c-41ed-96f7-f103e46a0660 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.833918 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 205/396] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:39.839699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.839990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.840320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.872185 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 192/397] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:39.877865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:39.879470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:39.895617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:39.993478 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 206/398] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:40.019281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c97b-25cb-4416-ba57-75eab9d94c99 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.023850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.045786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.063783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f9f2f-31b5-45b7-9e8a-8b9831b62813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.064600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f9f2f-31b5-45b7-9e8a-8b9831b62813 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.064884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f9f2f-31b5-45b7-9e8a-8b9831b62813 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.065172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f9f2f-31b5-45b7-9e8a-8b9831b62813 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.076205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f9f2f-31b5-45b7-9e8a-8b9831b62813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e70f9f2f-31b5-45b7-9e8a-8b9831b62813 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:40.085014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:40.085947 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:40.086850 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 193/399] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:40.087960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec19f1-e7d1-4234-8a2f-301f7dd7f506 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.093159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec19f1-e7d1-4234-8a2f-301f7dd7f506 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.093159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec19f1-e7d1-4234-8a2f-301f7dd7f506 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.093159 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 194/400] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:40.093159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec19f1-e7d1-4234-8a2f-301f7dd7f506 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.093728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.186973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436261f5-3146-4765-9a5e-da65f2c96663 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.212758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec19f1-e7d1-4234-8a2f-301f7dd7f506 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.226547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ff36-4797-4172-b130-d101b5ae33bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.227351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ff36-4797-4172-b130-d101b5ae33bf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.227632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ff36-4797-4172-b130-d101b5ae33bf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.227905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ff36-4797-4172-b130-d101b5ae33bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.240514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ff36-4797-4172-b130-d101b5ae33bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-7a28ff36-4797-4172-b130-d101b5ae33bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:40.248982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:40.250512 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:40.251293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:40.255695 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 207/401] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:40.257058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.257369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.257650 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.258360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.259371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.259798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.260217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.261110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:40.261598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.263223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.273798 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 195/402] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:40.274954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.276566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:40.278039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:40.323170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.354026 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 208/403] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:40.355198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.392561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088fbbf-f19b-45bc-a910-19e2822e40ab None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.393678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.432772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.433761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.434220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.434705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.435719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:40.436169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.438313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.447627 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 196/404] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:40.448797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.480955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1063b0-8af1-4c3e-bb0c-4ab0da489a6d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.528791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.529943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.530325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.530671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.532288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.534245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.538437 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 209/405] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:40.539616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.573825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e7fe8-679a-472e-b25c-477a48a950f3 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.576593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.618298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.619366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.620489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.620859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.633834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:40.644183 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:40.645079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:40.646243 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 197/406] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:40.647015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.657355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5059d-bbd7-4ceb-88e5-52eb91ade898 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.660152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.702782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.704278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.704629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.705065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.706722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.708495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.713216 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 210/407] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:40.714291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.778637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7b26-657b-4c8b-b7c2-6ad1ca9ee02e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.822389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.823169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.823450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.823732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.825491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.827222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.828970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4df48-f6ef-4122-bb22-3f757b7ef4a8 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.829849 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 198/408] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:40.830711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.869237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.870542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.871107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.871630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.872725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:40.873255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.874458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.876393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.887756 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 211/409] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:40.889084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.927165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:40.959818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc01e98-d7d4-4943-a9a9-002d1f3be300 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.002206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.003578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.004111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.004587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.006028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.006590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb99fb5-e96b-4547-ad63-2e57fc413b09 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.008027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.010444 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 199/410] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:41.011426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.051886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.052968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.053305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.053585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/groups/05f96f50050643a69201867e2409e1f5/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.056786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5280780ca34f3186e3a4cbeea7a396, group_id=05f96f50050643a69201867e2409e1f5, role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.058546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.080348 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 212/411] 10.222.0.45 () {58 vars in 1442 bytes} [Mon May 23 12:33:40 2022] PUT /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/groups/05f96f50050643a69201867e2409e1f5/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:41.081284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.143818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:41.147737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b729-3b0b-425a-8437-1fe912de0493 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.194054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.194953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.195251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.195521 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] PATH_INFO: `/v3/groups/7b1b0e3d2fc74354ac19b17443703430` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.196884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] RBAC: Authorizing `identity:get_group(group_id=7b1b0e3d2fc74354ac19b17443703430)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.198665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.201076 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 200/412] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:41 2022] GET /identity/v3/groups/7b1b0e3d2fc74354ac19b17443703430 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:41.210269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.221064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:41.241109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a37a-9d8e-4234-8b8c-ee80a06b627c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.321794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.324092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.324982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.327140 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/groups/05f96f50050643a69201867e2409e1f5/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.332483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5280780ca34f3186e3a4cbeea7a396, group_id=05f96f50050643a69201867e2409e1f5, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.335912 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.356048 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 213/413] 10.222.0.45 () {58 vars in 1442 bytes} [Mon May 23 12:33:41 2022] PUT /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396/groups/05f96f50050643a69201867e2409e1f5/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:41.404769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7651a0-6757-4db1-879a-7962faa0213b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.446339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a135e-180b-46ab-9d64-2332c6899cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.447598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a135e-180b-46ab-9d64-2332c6899cdf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.448125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a135e-180b-46ab-9d64-2332c6899cdf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.448622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a135e-180b-46ab-9d64-2332c6899cdf None admin] PATH_INFO: `/v3/projects/42a3411808a2449f8a4f73e9a1925a0f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.450256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a135e-180b-46ab-9d64-2332c6899cdf None admin] RBAC: Authorizing `identity:get_project(project_id=42a3411808a2449f8a4f73e9a1925a0f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.451930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a135e-180b-46ab-9d64-2332c6899cdf None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.454944 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 201/414] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:41 2022] GET /identity/v3/projects/42a3411808a2449f8a4f73e9a1925a0f => generated 344 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:41.460463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.538458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9752a-eb1a-46a8-9768-2dc7521bd529 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.539017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9752a-eb1a-46a8-9768-2dc7521bd529 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.539343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9752a-eb1a-46a8-9768-2dc7521bd529 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.540918 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 202/415] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:41.546270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.549266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.549844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.573766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:41.575239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:41.583781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96553ea4-c746-4dd7-8ac0-a34a18b355ab None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.634895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:41.643082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.644379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.644857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.645355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] PATH_INFO: `/v3/projects/42a3411808a2449f8a4f73e9a1925a0f/groups/7b1b0e3d2fc74354ac19b17443703430/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.647575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] RBAC: Authorizing `identity:create_grant(project_id=42a3411808a2449f8a4f73e9a1925a0f, group_id=7b1b0e3d2fc74354ac19b17443703430, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.649403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.668073 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 214/416] 10.222.0.45 () {58 vars in 1442 bytes} [Mon May 23 12:33:41 2022] PUT /identity/v3/projects/42a3411808a2449f8a4f73e9a1925a0f/groups/7b1b0e3d2fc74354ac19b17443703430/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:41.687120 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 203/417] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:41.714108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.735281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:41.834743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844787d3-46da-43ea-b845-c14b025f95ed None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.872634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.873479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.873768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.874038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.886186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:41.894336 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:41.895281 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:41.896043 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 215/418] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:41.901839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.021991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d9f2-ded1-493c-b2a3-9dcf2a85afba None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.059990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.060668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.060950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.061257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.062019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] RBAC: Adding query filter params (name=member) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:42.062328 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.063882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e0f1-2f77-4cb7-8863-8a3d5a1e216b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.073333 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 204/419] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:42.079257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.199839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.237725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72c01d-5c23-417c-9723-dd2b686703df None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.287258 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.287916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.288203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.288485 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.373114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.374749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.377500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab958-2d58-4f86-9a57-f5f210c21ab9 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.377812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab958-2d58-4f86-9a57-f5f210c21ab9 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.378095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab958-2d58-4f86-9a57-f5f210c21ab9 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.379793 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 205/420] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:42.384701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.386924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.387413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.415277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:42.418195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:42.465499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.503890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.542494 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 206/421] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:33:42.548363 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 216/422] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:42.553974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.580776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.730642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ffd43-0985-40ef-a699-47439e75fd40 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.755571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd413568-6f07-45f2-a609-de81e5cdfe7b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.793372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.794615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.794902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.795182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.796502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.798642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.800788 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 207/423] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:42.808216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.811923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.812844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.813121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.813429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.827855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:42.837982 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:42.839314 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:42.840063 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:42.840642 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 217/424] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:42.859036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.869592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.941511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.964830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976184-e0d2-431b-82d4-69437a4108d4 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.032973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.033947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.034233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.034512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.035891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.037370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.040211 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 208/425] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:43.046216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.079362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e04c1-5fbf-4681-a86b-f6249a04950b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.149580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.150257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.150540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.150820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.151581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:43.151894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.153322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.174537 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 218/426] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:43.179236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.197527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.201685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe5317-bc35-41fb-8908-e413a890a950 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.254829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.255901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.256381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.256852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.257903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=d39b4a0e688043b99489aaa38b5ea663) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:43.258409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.260045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.275157 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 209/427] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 611 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:43.335061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf99ab9-b9b4-4444-af1f-55ea9ff98e8c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.357655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.412051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c298fe0-cfff-4b2c-ba0a-31e4932f5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.412724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c298fe0-cfff-4b2c-ba0a-31e4932f5f6e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.413005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c298fe0-cfff-4b2c-ba0a-31e4932f5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.413304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c298fe0-cfff-4b2c-ba0a-31e4932f5f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.524382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c298fe0-cfff-4b2c-ba0a-31e4932f5f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.525908 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c298fe0-cfff-4b2c-ba0a-31e4932f5f6e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.643305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.653477 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 219/428] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:33:43.656205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.767444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39c50-5771-4f5b-8ffb-8d088f7e717a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.798221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0f5b9-db3b-45cc-9144-55b5b9dbc025 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.798670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0f5b9-db3b-45cc-9144-55b5b9dbc025 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.798952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0f5b9-db3b-45cc-9144-55b5b9dbc025 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.804823 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 220/429] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:43.806327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.806617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.806901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.808952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.810070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.810544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.811007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] PATH_INFO: `/v3/projects/d39b4a0e688043b99489aaa38b5ea663` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.812517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] RBAC: Authorizing `identity:get_project(project_id=d39b4a0e688043b99489aaa38b5ea663)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.814463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.816645 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 210/430] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/projects/d39b4a0e688043b99489aaa38b5ea663 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:43.822151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.827612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:43.829433 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.852071 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.919650 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 221/431] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:43.933263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953281-939b-4096-a44e-4262dd039bcf None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.949196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.970856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.971728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.972011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.972285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.973595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.975095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.977062 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 211/432] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:43.984485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.080626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dca5e-c20c-44ee-9e9a-06a63aba254f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.088937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.095473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753386a-3b97-4201-a2a0-7bba1365ccaa None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.112837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.122947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de54a6-f049-4d91-9b59-c3e5ae104304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.124109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de54a6-f049-4d91-9b59-c3e5ae104304 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.124215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de54a6-f049-4d91-9b59-c3e5ae104304 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.125497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de54a6-f049-4d91-9b59-c3e5ae104304 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.142085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de54a6-f049-4d91-9b59-c3e5ae104304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:44.144016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.144682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.144964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.145313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.146157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=d39b4a0e688043b99489aaa38b5ea663) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:44.146470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.147912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-e0de54a6-f049-4d91-9b59-c3e5ae104304 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:44.150552 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:44.151401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:44.152178 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 222/433] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:44.153366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783a48-576b-4206-9596-16d6da03677d None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.154284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783a48-576b-4206-9596-16d6da03677d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.154284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783a48-576b-4206-9596-16d6da03677d None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.155333 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 223/435] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:44.159459 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 212/435] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=d39b4a0e688043b99489aaa38b5ea663&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:44.162266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.162690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.162967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.163243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.196387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:44.197886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:44.301246 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 224/436] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:44.328913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216cdf2-5a71-4e55-b583-b487cbfe247c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.329268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.378582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.379728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.380222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.380795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.381853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:44.382431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.384046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.395261 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 213/437] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:44.400609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.429721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.474012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cfe0c-870f-4356-91c3-ac1c47e33eb8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.495965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.520547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.521542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.521816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.522089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.535326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ac895-7e49-4d13-85cf-5d287e4c0c1d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.538683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:44.547622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:44.548507 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:44.549696 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 225/438] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:44.554924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.576045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.579146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.579146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.579146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.670930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.672742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.678121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988cade-1189-49a9-9e44-7ea723f06cb9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.705320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.729595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.731232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.731515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.731791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.732898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] RBAC: Adding query filter params (name=member) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:44.733224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.734848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.744943 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 226/439] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:44.751240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.795631 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 214/440] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:33:44.801381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.801899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.872581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbbfcc-6cbd-45ad-b928-80b5b94c8c13 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.907256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db937a-ba30-4851-8c78-e464d50c9919 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.907433 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903f3b3-07b5-4002-af75-56fc2690eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.908006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f3b3-07b5-4002-af75-56fc2690eea6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.908287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f3b3-07b5-4002-af75-56fc2690eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.908552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f3b3-07b5-4002-af75-56fc2690eea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.927935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.943568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74f7e-27f2-467a-be9e-10c5a04e2826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.944422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74f7e-27f2-467a-be9e-10c5a04e2826 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.944703 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74f7e-27f2-467a-be9e-10c5a04e2826 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.944976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74f7e-27f2-467a-be9e-10c5a04e2826 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.946213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74f7e-27f2-467a-be9e-10c5a04e2826 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.948079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74f7e-27f2-467a-be9e-10c5a04e2826 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.950143 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 215/441] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:44.951888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5dd11-22eb-4a25-aadf-154e4801f562 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.952170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5dd11-22eb-4a25-aadf-154e4801f562 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.952445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5dd11-22eb-4a25-aadf-154e4801f562 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.955524 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 216/442] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:44.956255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5dd11-22eb-4a25-aadf-154e4801f562 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.978224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903f3b3-07b5-4002-af75-56fc2690eea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.979742 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903f3b3-07b5-4002-af75-56fc2690eea6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.017583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.056482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5dd11-22eb-4a25-aadf-154e4801f562 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.079855 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 227/443] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:45.081353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.081640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.081915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.091195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.092050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.092333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.092610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.093841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.095279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.096898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 217/444] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:45.097526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:45.097748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.098809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:45.156332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.166558 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 228/445] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:45.167419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.205839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e20478-2845-4863-8e42-5a5627a5b460 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.241238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.241420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.242040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.242327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.242610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] PATH_INFO: `/v3/projects/8e5280780ca34f3186e3a4cbeea7a396` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.243819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5280780ca34f3186e3a4cbeea7a396)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.245297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.246994 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 218/446] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/projects/8e5280780ca34f3186e3a4cbeea7a396 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:45.247763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.275924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329eac8c-209c-4044-98c7-bc9c81a0b5a1 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.309400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.310046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.310335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.310638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.311465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:45.311779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.313841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.319586 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 229/447] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:45.320367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.360218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c9d6-2361-41a4-9317-bd1fa0515890 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.397343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.410643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.411464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.411748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.412023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.426279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:45.434727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:45.435987 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:45.436748 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 219/448] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:45.442518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.445971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b802-b21d-4f90-b7e4-f521da52d190 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.481706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.492671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.493834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.494114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.494551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] PATH_INFO: `/v3/groups/05f96f50050643a69201867e2409e1f5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.495776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] RBAC: Authorizing `identity:get_group(group_id=05f96f50050643a69201867e2409e1f5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.497272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.504410 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 230/449] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/groups/05f96f50050643a69201867e2409e1f5 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:45.506243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.565552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f088b-07a9-4b87-9da7-3b00b5a1659c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.599718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.600390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.600673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.600948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.601731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:45.602042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.603400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.612358 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 220/450] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:45.617741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.620971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b7f38-6e68-4f57-ae8a-302e38f28712 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.654897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.655538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.655902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.656773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.657797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] RBAC: Adding query filter params (group.id=05f96f50050643a69201867e2409e1f5, role.id=7c75c0d6bb084b3389f8d26bebd09b23, scope.project.id=8e5280780ca34f3186e3a4cbeea7a396) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:45.658106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.659538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.663729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.665756 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 231/451] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/role_assignments?group.id=05f96f50050643a69201867e2409e1f5&scope.project.id=8e5280780ca34f3186e3a4cbeea7a396&role.id=7c75c0d6bb084b3389f8d26bebd09b23 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:45.721960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579ab8-4283-4c23-8036-73d514a2a17c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.759583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.760154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.760442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.760724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.833288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.834753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.883252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.939315 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 221/452] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:33:45.945062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.008615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:46.051212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e7c3d-d6a9-4ba0-8712-3a3248d787ff None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.085549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.086408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.086695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.086964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] PATH_INFO: `/v3/projects/42a3411808a2449f8a4f73e9a1925a0f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.088145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] RBAC: Authorizing `identity:get_project(project_id=42a3411808a2449f8a4f73e9a1925a0f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.089638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.091330 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 232/453] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/projects/42a3411808a2449f8a4f73e9a1925a0f => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:46.096848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.220595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0193a-0578-4008-be17-29110ba7f4da None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.255499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756383c-fc1d-4567-83cb-39d4b419618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.256359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756383c-fc1d-4567-83cb-39d4b419618d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.256649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756383c-fc1d-4567-83cb-39d4b419618d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.256927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756383c-fc1d-4567-83cb-39d4b419618d None admin] PATH_INFO: `/v3/groups/7b1b0e3d2fc74354ac19b17443703430` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.258132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756383c-fc1d-4567-83cb-39d4b419618d None admin] RBAC: Authorizing `identity:get_group(group_id=7b1b0e3d2fc74354ac19b17443703430)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.259590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756383c-fc1d-4567-83cb-39d4b419618d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.261243 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 222/454] 10.222.0.45 () {56 vars in 1180 bytes} [Mon May 23 12:33:46 2022] GET /identity/v3/groups/7b1b0e3d2fc74354ac19b17443703430 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:46.267236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.373791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f228-b1d3-4972-937b-72e2518db522 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.403569 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:46.408829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.409509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.409790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.410063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.410884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] RBAC: Adding query filter params (group.id=7b1b0e3d2fc74354ac19b17443703430, role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=42a3411808a2449f8a4f73e9a1925a0f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:46.411193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.412664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905c69-dbb4-4c89-a623-6ed010bc43af None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.418785 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 233/455] 10.222.0.45 () {56 vars in 1376 bytes} [Mon May 23 12:33:46 2022] GET /identity/v3/role_assignments?group.id=7b1b0e3d2fc74354ac19b17443703430&scope.project.id=42a3411808a2449f8a4f73e9a1925a0f&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:49.143419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f55b-8968-4dbe-8767-f4f022bac304 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.143936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f55b-8968-4dbe-8767-f4f022bac304 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.144045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f55b-8968-4dbe-8767-f4f022bac304 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.145349 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 223/456] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:49.154528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39096395-2ee1-4a02-b6ca-b8f9d30e71c2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.155349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39096395-2ee1-4a02-b6ca-b8f9d30e71c2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.155879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39096395-2ee1-4a02-b6ca-b8f9d30e71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.186129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-39096395-2ee1-4a02-b6ca-b8f9d30e71c2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:49.188487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-39096395-2ee1-4a02-b6ca-b8f9d30e71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:49.278718 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 234/457] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:49.291900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bc329-b8b7-4e2c-b698-5e123780b683 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.292479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bc329-b8b7-4e2c-b698-5e123780b683 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.292981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bc329-b8b7-4e2c-b698-5e123780b683 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.294795 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 224/458] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:49.301492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.302075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.302545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.314288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bc329-b8b7-4e2c-b698-5e123780b683 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:49.331969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:49.333235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:49.353513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:49.446074 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 235/459] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:49.475727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bc329-b8b7-4e2c-b698-5e123780b683 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:49.520813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:49.521645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.521926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.522203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.527752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:49.534279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:49.535745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-07bbb919-0118-4a25-826c-eba7fbdc5e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:49.560653 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:49.561666 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:49.563218 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:49.563218 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:49.563218 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:49.563218 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:49.563218 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 225/460] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:49.566510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa91e2a-fc86-427c-9b0c-1e3d051f37af None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.567020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa91e2a-fc86-427c-9b0c-1e3d051f37af None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.567494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa91e2a-fc86-427c-9b0c-1e3d051f37af None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.569300 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 226/461] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:49.570202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa91e2a-fc86-427c-9b0c-1e3d051f37af None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:49.599224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:49.650320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d94ab-6504-4ae4-afae-6ddd89e62531 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:49.655154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:49.689391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:49.689820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.690103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.690384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.702199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:49.703754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:49.709389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa91e2a-fc86-427c-9b0c-1e3d051f37af None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-9fa2f3ae-ec1b-4f49-a3d5-cbb2b2f15d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:49.730862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:49.731759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:49.732581 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:49.732581 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:49.732581 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:49.732581 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:49.735985 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 236/462] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:49.737414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.737827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.738228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.756298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:49.757220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.757450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:49.757833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.758249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.758940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:49.759269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:49.759732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:49.761538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:49.782453 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 227/463] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:49.782453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:49.857582 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 237/464] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:49.858851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:49.910201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:49.926124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfb959-7698-47d4-8c79-80765cd36170 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:49.956235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:49.971583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:49.972614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:49.973113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:49.973620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:49.975089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:49.975878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:49.978306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:49.987297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34597db-9043-4771-ad1d-ae3d89924bb8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:49.995655 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 228/465] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:49.996781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.023912 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6808632-71c1-45e8-bb10-f484a3400a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.024586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808632-71c1-45e8-bb10-f484a3400a41 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.024853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808632-71c1-45e8-bb10-f484a3400a41 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.025125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808632-71c1-45e8-bb10-f484a3400a41 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.025846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6808632-71c1-45e8-bb10-f484a3400a41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.027294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6808632-71c1-45e8-bb10-f484a3400a41 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.051406 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 238/466] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:49 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:50.052715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b2643-7c28-48af-87e6-6f6bcdaddabc None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.053080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b2643-7c28-48af-87e6-6f6bcdaddabc None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.053457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b2643-7c28-48af-87e6-6f6bcdaddabc None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.059188 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 239/467] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:50.059188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b2643-7c28-48af-87e6-6f6bcdaddabc None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.144739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b39432-2165-43d5-a779-baafc04d9a13 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.176575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:50.189165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b2643-7c28-48af-87e6-6f6bcdaddabc None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.200831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.202462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.203235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.203916 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.220415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.222445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.233477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.234292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.234757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.235192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.236744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.238508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-53a82ab8-320f-4c46-a594-98d1c19c40ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:50.247690 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:50.248629 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:50.250226 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:50.250226 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:50.250226 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:50.250226 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:50.251203 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 229/468] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:50.252580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.252869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.253210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.267036 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 240/469] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:50 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:50.269403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.275682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:50.276911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:50.317637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:50.368462 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 230/470] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:50.396149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.402357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42084dab-7730-405f-8428-41001a1b3a07 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.444840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.445931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.446216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.446498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.447247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:50.447559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.448993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.474250 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 241/471] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:50.480664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.498506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:50.544299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722807d-fb72-4df3-9918-0a4e2d2bb753 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.585125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.586587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.586587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.586587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.598044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.599509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1187f57e-19a8-4770-9c4c-312e422df33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:50.619092 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:50.619941 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:50.620839 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:50.620839 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:50.620839 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:50.620839 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:50.620839 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 231/472] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:50.621100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6763-9e7f-4992-928d-b2bc90b1b5e3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.621191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad00e-a4fd-4c0f-877b-756bea2cde17 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.621191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad00e-a4fd-4c0f-877b-756bea2cde17 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.621191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad00e-a4fd-4c0f-877b-756bea2cde17 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.628953 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 232/473] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:50.630249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad00e-a4fd-4c0f-877b-756bea2cde17 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.657276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:50.661245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd47f-a80f-4280-8031-2d3acf2ecf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.662065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd47f-a80f-4280-8031-2d3acf2ecf93 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.662568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd47f-a80f-4280-8031-2d3acf2ecf93 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.662768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd47f-a80f-4280-8031-2d3acf2ecf93 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.663710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd47f-a80f-4280-8031-2d3acf2ecf93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.665263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd47f-a80f-4280-8031-2d3acf2ecf93 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.693244 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 242/474] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:50 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:50.693244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.693244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.693244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.731232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:50.732620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:50.840701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad00e-a4fd-4c0f-877b-756bea2cde17 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.841577 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 243/475] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:50.842102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:50.866532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.918846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.919863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.920309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.920734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.921831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:50.922651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.925247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.939264 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 233/476] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:50.944746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.984652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922654-e7a7-4e11-8539-0abe390b45fb None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:51.023869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:51.024556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:51.024836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:51.025111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:51.025902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:51.027292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:51.035883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.sql.core [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 12:33:51.035883 dv-cinder-master-3-smb devstack@keystone.service[90356]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 12:33:51.035883 dv-cinder-master-3-smb devstack@keystone.service[90356]: [parameters: {'id': 'b16cebcc4d714f92a6e6188f606639a1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 12:33:51.035883 dv-cinder-master-3-smb devstack@keystone.service[90356]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90356) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 12:33:51.051189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application conn.query(q) May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result.read() May 23 12:33:51.054525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return ref.to_dict() May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:33:51.055471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application next(self.gen) May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application yield resource May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application next(self.gen) May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.session.rollback() May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.force_reraise() May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise self.value May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application session.commit() May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 12:33:51.056325 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._prepare_impl() May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.session.flush() May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._flush(objects) May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application compat.raise_( May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application flush_context.execute() May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rec.execute(self) May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 12:33:51.057154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:33:51.057991 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application conn.query(q) May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result.read() May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:33:51.058759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [parameters: {'id': 'b16cebcc4d714f92a6e6188f606639a1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:51.059496 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 12:33:51.060243 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:51.061023 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 244/477] 10.222.0.45 () {60 vars in 1131 bytes} [Mon May 23 12:33:50 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:51.065186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:51.075646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01ca8-0cdc-4268-9760-9dba1ab7389a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:51.114423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:51.115331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:51.115878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:51.116299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:51.117187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:51.119000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:51.134473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:51.146626 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 234/478] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:50 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:51.192956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c567-bd30-45a0-87eb-06ec54b8c709 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:51.245042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b36fd-d8f6-43c9-b8aa-4a6fb59cd0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:51.245813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b36fd-d8f6-43c9-b8aa-4a6fb59cd0ba None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:51.246094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b36fd-d8f6-43c9-b8aa-4a6fb59cd0ba None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:51.246366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b36fd-d8f6-43c9-b8aa-4a6fb59cd0ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:51.259081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b36fd-d8f6-43c9-b8aa-4a6fb59cd0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-988b36fd-d8f6-43c9-b8aa-4a6fb59cd0ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:51.268793 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:51.269758 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:51.270959 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 245/479] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:33:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:51.275999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:51.394347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3ea07-2385-4810-bf26-d8e6f1b66090 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:51.430115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:51.430785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:51.431073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:51.431354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:51.432107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:51.432417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:51.433838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec4922-9622-46e8-9948-6eb0c59b0eb9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:51.436154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:51.444136 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 235/480] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:52.981170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fab59-c938-4d41-b0d4-7db986bce48f None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:52.984598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fab59-c938-4d41-b0d4-7db986bce48f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:52.984598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fab59-c938-4d41-b0d4-7db986bce48f None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:52.984598 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 246/481] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:52.988693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53509-22e3-4a32-a495-5340b567b988 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:52.989127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53509-22e3-4a32-a495-5340b567b988 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:52.989337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53509-22e3-4a32-a495-5340b567b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.018185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-98c53509-22e3-4a32-a495-5340b567b988 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:53.019481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-98c53509-22e3-4a32-a495-5340b567b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.107529 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 236/482] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:53.135644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe402b-2918-4885-9a08-da1b41a1b6e2 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.135977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe402b-2918-4885-9a08-da1b41a1b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.136203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe402b-2918-4885-9a08-da1b41a1b6e2 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.137980 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 247/483] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:53.143705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.143990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.144271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.163992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:53.164541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe402b-2918-4885-9a08-da1b41a1b6e2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.165209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.264161 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 237/484] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:53.295862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.337547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe402b-2918-4885-9a08-da1b41a1b6e2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.383053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.408123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.409297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.409484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.409966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.411263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.431486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:53.440524 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:53.441494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:53.442348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:53.446939 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 248/485] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:53.456386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.486878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7359b-8b1f-467b-93b2-074c64fb04a8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.529818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.530903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.531192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.531468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.545376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:53.555506 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:53.556451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:53.557272 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 238/486] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:53.562888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.680231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad95b9e-81ca-4e49-bf56-313dc073c073 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.700506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.723358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.724038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.724325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.724606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.725398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:53.725825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.727313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.737155 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 239/487] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:53.737903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da61ab-7d47-46f4-a6a7-7c26a0103aca None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.746266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.787344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.787938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.788222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.788499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.789281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:53.789590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.791005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.808743 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 249/488] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:53.814925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.871015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b8c7-9a76-4255-bcc9-680046c458bd None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.878915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.911488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.912284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.912569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.912847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.925273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.926746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.942213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b50d2-27cd-4957-ab32-e789940d9f34 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e55122e7-e2be-488d-94cd-fc9f9453507d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:53.947001 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:53.948051 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:53.949056 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:53.949056 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:53.949056 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:53.949056 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:53.949056 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 240/489] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:53.953169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07fb7b-2791-4a13-80ff-3b148ddf7043 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.953169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07fb7b-2791-4a13-80ff-3b148ddf7043 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.953169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07fb7b-2791-4a13-80ff-3b148ddf7043 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.953169 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 241/490] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:53.956837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07fb7b-2791-4a13-80ff-3b148ddf7043 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.979490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.980544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.980822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.981093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.991843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.994749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.997424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-24afb4d4-96ca-402f-be6a-3eb1363d1aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:54.016242 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:54.017174 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:54.018015 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:54.018015 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:54.018015 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:54.018015 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:54.022011 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 250/491] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:54.023099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.023387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.023664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.042933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:54.044064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.073603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07fb7b-2791-4a13-80ff-3b148ddf7043 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.112639 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.113346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.113634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.113911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.114664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:54.114976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.116413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7967d5-feb6-4146-85f3-e4f5936d5c6d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.130827 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 242/492] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:54.131226 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 251/493] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:54.132177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d38be8-3288-4bcc-8fe7-5b22deaaae8e None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.132468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d38be8-3288-4bcc-8fe7-5b22deaaae8e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.132746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d38be8-3288-4bcc-8fe7-5b22deaaae8e None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.132959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.133980 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 243/494] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:54.135907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d38be8-3288-4bcc-8fe7-5b22deaaae8e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.164592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.243698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.247924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578ab9-6351-4804-ba49-7ca309f3988b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.254904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d38be8-3288-4bcc-8fe7-5b22deaaae8e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.285218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.286021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.286308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.286589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.287317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:54.287634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.289038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860067-fa40-4147-8a38-bebfaef4990a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.290925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.291728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.292012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.292288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] PATH_INFO: `/v3/users/glance` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.300469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.301854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.302490 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 252/495] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:54.303741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b111c2-b3e0-49a4-a034-062b51c17487 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.304031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b111c2-b3e0-49a4-a034-062b51c17487 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.304310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b111c2-b3e0-49a4-a034-062b51c17487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:33:54.318444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:54.319385 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:54.320281 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 244/496] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:54.320870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.322336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f9b111c2-b3e0-49a4-a034-062b51c17487 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:54.323708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f9b111c2-b3e0-49a4-a034-062b51c17487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.393708 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 253/497] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:54.395193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc203-f59b-47b4-8973-942514941c77 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.395479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc203-f59b-47b4-8973-942514941c77 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.395756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc203-f59b-47b4-8973-942514941c77 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.396988 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 254/498] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:54.397720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc203-f59b-47b4-8973-942514941c77 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.415147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.444798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab916d-8447-4dad-aca6-7587cc7e7366 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.478003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.478793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.479074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.479347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.489466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:54.497117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:54.498040 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:54.498785 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 245/499] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:54.499951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.506758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc203-f59b-47b4-8973-942514941c77 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.514347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.542513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.543292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.543568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.543840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] PATH_INFO: `/v3/users/nova` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.551207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.552597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-1a543bb8-7e33-48c7-806b-4818afb6324b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:33:54.568748 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:54.569764 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:54.570638 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 255/500] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:54.571196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.571494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.571729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.588086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:54.589296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.606648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315a511-893e-4ef1-ab84-91f0fb621913 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.639564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.640263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.640546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.640820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.641680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:54.641991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.643426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.655297 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 256/501] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:54.656945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.659941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.688754 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 246/502] 10.222.0.45 () {56 vars in 1137 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:54.688754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.753962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.763191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85e90-cd78-4f1f-aa1d-0fd0aba948d7 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.785943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38897742-ded9-4045-9c8c-8a56041eeecf None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.798396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.799199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.799483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.799763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.809880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:54.818181 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:54.819093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:54.819853 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 257/503] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:54.820503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.821742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.822404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.822688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.822960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.823704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:54.824181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.825404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.833502 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 247/504] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:54.834287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.883636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.922473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d160f1c-91a9-4008-a98d-92db2832ac4b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.933448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ef97c-2a4c-4f15-9697-750d5a27d561 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.957331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.957987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.958259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.958540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.959356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:54.959663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.961211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.964226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.970171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.970958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.971241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.971517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.982248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.983717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.998560 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 258/505] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:54.999413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:55.000562 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:55.001679 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:55.002493 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:55.002493 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:55.002493 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.002493 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:55.005393 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 248/506] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:55.006151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.100502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863529c-0573-465d-916d-51bffdf8aa2b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.107120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90983-b434-429f-944c-3c8fa294e146 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.122767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.135299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.135944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.136223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.136498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.140843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.141533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.141822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.142104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.142853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:55.143166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.144540 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.152516 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 249/507] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:55.153346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.204180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.206127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.207711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.259017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c5806-a860-406e-9166-466bc1dc1be5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.292500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.293319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.293608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.293885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.304728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.306211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.307009 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 259/508] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:55.307592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:55.328451 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:55.329381 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:55.330248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:55.330248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:55.330248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.330248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:55.330248 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 250/509] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:55.330502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.336165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.415841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90927-b4e7-4018-ab43-c187601b0c94 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.428481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.432829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2e172-c591-49cc-ad65-8fa651a68555 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.449906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.450546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.450828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.451103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.467570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.468992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.469397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.469675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.470396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:55.470697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.472069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.484667 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 251/510] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:55.485507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.523113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.524985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.549265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.584285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84414365-12bd-4a0e-9024-63bab41e3b0e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.619175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.619971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.620268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.620548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.626638 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 260/511] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:55.627595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.631168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.632831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:55.650316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:55.651159 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:55.651960 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:55.651960 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:55.651960 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.651960 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:55.651960 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 252/512] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:55.652292 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.664771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.727670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff67e5d-e4ce-4648-97d5-2660d9caf258 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.752601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.752779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746450-21fa-4af7-916b-b02f4d9fed4d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.764184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.765022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.765345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.765674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.775884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.777396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.786989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.787676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.787957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.788241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.788958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:55.789301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.790654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:55.796886 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:55.797836 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:55.798654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:55.798654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:55.798654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.798654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:55.798654 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 261/513] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:55.798937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.804436 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 253/514] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:55.805291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.876041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.899754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fe74-a6cc-4ed4-9666-f6f40e8f8318 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.907324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863de8-55f4-4bd7-8823-b9063cca3c23 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.934046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.934710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.934997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.935275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.935974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.937486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.940300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.941080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.941394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.941675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.952775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.954296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.958046 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 262/515] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:33:55 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:55.958877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:55.972908 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:55.973877 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:55.974773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:55.974773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:55.974773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:55.974773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:55.974773 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 254/516] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:55.975997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.998840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.086101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609569f-83d2-4455-b997-5ed884ecbb6f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.094367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80558b98-92cf-4ae1-88f0-fb93d7318f39 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.119807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.127854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.128662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.128946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.129318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.130105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.130425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.131850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.133580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.134247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.134548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.134805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.135539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.135850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.137233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.147338 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 263/517] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.148196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.156102 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 255/518] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.156102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.258526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.268617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991e2d0-a5dc-403b-8838-ab714b02454b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.275288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d170fd2-075a-4f01-b83e-b247af8e5267 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.304945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.305769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.306055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.306346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.313719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.314334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.315181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.315440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.315970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.316252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.316977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.317314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.318679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.331431 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 256/519] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:33:56.332466 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:56.333338 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:56.334206 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 264/520] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:56.334788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.335515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.392622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.449081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ad82b-2d78-4234-b45a-723818c18a7c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.457690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1f7f-9ba8-41eb-997b-d5cb8ca276a3 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.485886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.486669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.486956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.487230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.495985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.497087 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.497487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.497909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.498189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.498460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.507325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.508897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:33:56.514235 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:56.515118 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:56.515943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:56.516468 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 265/521] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:56.517672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.530687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:33:56.532528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:56.533699 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:33:56.534567 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:56.537305 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 257/522] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:56.538149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.628397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f278ea-328b-44fc-abaf-3dbad146feab None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.658296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32909-51e9-4d1d-bc20-3df72bc794e3 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.660055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.665019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.665841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.666117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.666386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.674380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.675839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:33:56.690381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:56.691345 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:56.692165 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 266/523] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:56.692604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.699887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.700793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.701159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.701533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.702512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.702899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.704428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.726272 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 258/524] 10.222.0.45 () {56 vars in 1137 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.727513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.772684 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.804706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae629f-6722-40dd-8ab9-121345db6627 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.842889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.844305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.844597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.844879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.845702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.846019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.846928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e00f-c460-4e20-97ee-1751a6417980 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.847504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.866809 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 267/525] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.872134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.884789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.885493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.885773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.886052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.886895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.887205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.888663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.911811 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 259/526] 10.222.0.45 () {56 vars in 1139 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.911811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.930247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.985301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079d6e5-a378-48fc-a112-9b6c46121894 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.016260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eac15-40ab-463e-8c08-e6e98e95bd28 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.020025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.026933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.027878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.028340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.029009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.030280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:57.031086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.032894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.045732 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 268/527] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:57.047163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.057757 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.058495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.058783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.059062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.127331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.128821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.147851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.164559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3180c-d5cf-4f50-96d1-87165183aa86 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.201385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.202278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.203220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.203667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.204667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=1f50c773fb0c4b1bb1da7133725f7d7f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:57.205131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.206773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.212843 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 269/528] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/role_assignments?user.id=1f50c773fb0c4b1bb1da7133725f7d7f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:57.213863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.245620 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 260/529] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:57.246879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.289038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.367791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ca11-7aa5-459d-b543-affd719e9987 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.375962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbbe83-7e8c-4a8b-bba8-ca910f081ac9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.396327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.416834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.417534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.417822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.418100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.418955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=e8c5ebd15be54c6badb07f37d58bda07) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:57.419287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.420718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.421264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.422440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.423301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.423783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.433633 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 261/530] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/role_assignments?user.id=e8c5ebd15be54c6badb07f37d58bda07&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:57.434684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.543021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.545447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.646983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645b485-7830-4f00-bd36-b4067718d49e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.669735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.722509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.723319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.723604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.723888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.747357 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 270/531] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:33:57.748514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.750591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.754141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:57.785743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:57.786648 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:57.787471 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:57.787471 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:57.787471 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:57.787471 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:57.794940 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 262/532] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:57.814379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.887276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecc8eb-1223-4f17-aa7b-703f13009853 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.915744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.939116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.940740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.941021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.941326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.962125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.963597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:57.998885 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:58.000188 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:58.001067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:58.001067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:58.001067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:58.001067 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:58.002484 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 271/533] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:58.008438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.026804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.052478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1fcf-b3be-4723-bf6c-af53e28b01e1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.124095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.124832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.125108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.125405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.126135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:58.126442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.127817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.147722 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 263/534] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:58.157787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.235972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841eb4e-7e66-46a0-9cd5-3987b3b3fc3c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.288810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.292449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.293830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.294609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.295090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.296072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:58.296692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980d7e0-81ea-433e-bf69-2e955dfa43ab None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.296802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.298623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954907-ecc8-4c8f-9035-63d50fd7d046 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.318458 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 272/535] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:58.319925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6949a3-1da5-4edf-90e2-cdf5f268f908 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.320247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6949a3-1da5-4edf-90e2-cdf5f268f908 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.320590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6949a3-1da5-4edf-90e2-cdf5f268f908 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.326679 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 273/536] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:58.330151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6949a3-1da5-4edf-90e2-cdf5f268f908 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.348927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.350133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.350644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.351140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.359842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.361659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-0b699c11-6b36-4378-b454-64394cfe6d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:33:58.381677 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:58.382625 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:58.383427 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:58.386143 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 264/537] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:58.387791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.388397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.388873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.405428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.410222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:58.412714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:58.446305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6949a3-1da5-4edf-90e2-cdf5f268f908 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.485482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.486426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.486718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.487054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.491665 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 265/538] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:33:58.492923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.503196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.504814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:33:58.533108 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:58.534034 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:58.535508 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 274/539] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:58.540548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.590581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.608855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea626-6c23-4555-94e3-4603108b8981 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.642872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf930fc5-c539-497f-8c55-78ab7fe0aed4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.645839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.646508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.646791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.647070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.647861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:58.648169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.649661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.668893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.670193 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 266/540] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:58.672079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.679071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.679863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.680143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.680422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.693717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:33:58.703599 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:58.704456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:33:58.705238 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:33:58.709219 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 275/541] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:58.710246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.787036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b6241-cc5f-478b-a42c-3dd45215297c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.828506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8943663-a0ae-46e1-aa07-be76d4a8afc2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.833120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.834076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.834617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.835106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.836255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:58.836777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.838568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.852763 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 267/542] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:58.854040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.858367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.869411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.869969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.870247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.870523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.871349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=ae6a98bfbada4666852398c78efce936) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:58.871660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.873094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.879893 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 276/543] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/role_assignments?user.id=ae6a98bfbada4666852398c78efce936&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:58.880507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.995996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932332-396b-46f3-b9e2-1358fa822546 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.010711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.038596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.039836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.040324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.040807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.042344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:59.042860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.044523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.055383 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 268/544] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:59.061268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.129134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f9741-3f6a-4406-91f5-25761ca63ad7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.135518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.166150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.166576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.166865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.167142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.167987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=65f0216a9bf54212a72d41ce9f6cc01c) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:59.168279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.169754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.176000 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 277/545] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/role_assignments?user.id=65f0216a9bf54212a72d41ce9f6cc01c&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:59.177183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5a30-4a53-425d-aa6b-de3002d7c6b0 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.215859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.217054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.217562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.218585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.232092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.234689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:33:59.253644 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:59.254502 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:59.255302 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:33:59.255302 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:33:59.255302 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:33:59.255302 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:59.257544 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 269/546] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:33:59.263423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.402501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9003-20b3-450b-a2ea-3f884aaef2f9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.426456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.455533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.456213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.456494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.456767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.457545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:59.457853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.459425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.476495 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 278/547] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:59.482272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.595889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06caff-38e9-4719-b5a9-9a8f8df4eaaf None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.615815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.636635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.637496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.637783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.638054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] PATH_INFO: `/v3/users/swift` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.647636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.649121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-9d53f3a2-e42b-4fd6-ada8-c7ebade7929c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:33:59.666352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:33:59.667804 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:33:59.669528 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 270/548] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:33:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:33:59.674266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.785884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1ffe-a00a-4c2e-8b47-1a9c11ee5ac6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.823374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.824048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.824326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.824612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.825486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:59.825796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.827261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bdc12-f817-4408-971f-e8b1d41dc0d8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.855624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52ee78-f44c-48b8-ad46-252bfec78b42 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.855955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52ee78-f44c-48b8-ad46-252bfec78b42 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.856238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52ee78-f44c-48b8-ad46-252bfec78b42 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.857846 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 271/549] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:59.862045 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 279/550] 10.222.0.45 () {56 vars in 1135 bytes} [Mon May 23 12:33:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:59.867533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52ee78-f44c-48b8-ad46-252bfec78b42 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.879337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.879625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.879889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.906865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:59.908099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:59.942355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.035769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52ee78-f44c-48b8-ad46-252bfec78b42 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.051455 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 280/551] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:00.083657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.098792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18c06-d926-4474-bd71-fc52e7923926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.099765 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18c06-d926-4474-bd71-fc52e7923926 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.100054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18c06-d926-4474-bd71-fc52e7923926 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.100336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18c06-d926-4474-bd71-fc52e7923926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.164780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.196900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18c06-d926-4474-bd71-fc52e7923926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.198917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18c06-d926-4474-bd71-fc52e7923926 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.209515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522408d-d71c-405f-ada0-015c9e01482c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.246209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a108-7814-4b51-ba62-c3797a5af47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.247151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a108-7814-4b51-ba62-c3797a5af47a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.247537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a108-7814-4b51-ba62-c3797a5af47a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.247913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a108-7814-4b51-ba62-c3797a5af47a None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.259388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90a108-7814-4b51-ba62-c3797a5af47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2e90a108-7814-4b51-ba62-c3797a5af47a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:00.268562 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:00.269777 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:00.270788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:00.272898 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 281/552] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:00.274365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae1f3-c5db-4114-8a55-2ed284809e0e None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.274753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae1f3-c5db-4114-8a55-2ed284809e0e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.275244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae1f3-c5db-4114-8a55-2ed284809e0e None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.281536 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 282/553] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:00.282538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ae1f3-c5db-4114-8a55-2ed284809e0e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.313359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.335007 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 272/554] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:34:00.335007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.335007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.335007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.365465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:00.366661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:00.417153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ae1f3-c5db-4114-8a55-2ed284809e0e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.440603 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 273/555] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:00.441797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.455428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.457532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.458972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.459596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.460147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.461162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:00.461672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.463350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.477545 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 283/556] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:00.478784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.564657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73542b85-cc5c-4e3d-a25b-37048833f68a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.568864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.593869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5d4b-9d14-455e-bb94-001d535fc3b7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.611431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.612392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.612872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.613171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.624737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.626443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.638176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.639187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.639622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.640103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:00.647572 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:00.648586 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:00.649470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:00.649470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:00.649470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:00.649470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:00.649701 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 274/557] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:00.654366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:00.655067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:00.664213 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:00.665658 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:00.666471 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:00.667077 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 284/558] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:00.673876 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.732226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.779944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497405a-77d5-4208-9027-4be9d8482762 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.814252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92068d-de72-48d5-b818-7ff5871a198e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.818014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.819145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.819645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.820159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.831480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.833195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:00.853490 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:00.854431 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:00.855621 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:00.855621 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:00.855621 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:00.855621 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:00.855835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.855835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.855835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.855835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.856106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:00.856177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.857546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.863052 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 275/559] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:00.864231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.876205 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 285/560] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:00.876205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.880246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.992584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9cca7-9ec7-433e-a23c-ce8f86ab7059 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.996014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494328b6-be2e-4e93-ad1d-993a94c3e296 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.012111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.035998 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.037365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.037982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.038340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.038727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.039017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.039302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.039695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.040337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:01.040508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:01.040774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.041263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.042192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.043097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.061300 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 276/562] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:01.061300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.062471 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 286/562] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:01.063643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.145982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.183580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a34ac-9fca-46f5-ac01-c45c92b8f565 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.194335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f92a7c-ab88-4705-988b-52ed407fe9b6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.223354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.224625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.225157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.225767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.234326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.235449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.236250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.236532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.236824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] PATH_INFO: `/v3/users/glance` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.237676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.250053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.251832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:01.257112 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:01.258031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:01.258907 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:01.263279 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 277/563] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:01.264310 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:01.272878 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:01.273889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 12:34:01.274827 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:01.282436 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 287/564] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:01.283666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.303945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.400650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719361-1ff5-455f-93f9-bf5f983fa45a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.410286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6de2be-d5f2-416c-b362-fc421e962328 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.435452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.447616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.448568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.448852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.449128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.453116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.454081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.454595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.455078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.456116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:01.456718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.458630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.460637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.463078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.476368 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 288/565] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:01.477658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:01.494747 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:01.495711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:01.496571 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:01.496571 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:01.496571 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:01.496571 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:01.496571 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 278/566] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:01.502074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.596338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfd3c-0592-4d1e-a914-247fcf470ba0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.612645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.630512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b05e8-f92c-4863-9f31-cabf0ce41dee None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.634088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.634746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.635036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.635330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.636152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:01.636462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.637938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.655885 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 289/567] 10.222.0.45 () {56 vars in 1137 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:01.656719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.673003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.673688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.673967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.674238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.675067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=5a9ea8c8127b48c483bd5e06b641253f) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:01.675372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.676802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b3e5-8aea-458d-870a-c1c7f2a133d5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.682269 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 279/568] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/role_assignments?user.id=5a9ea8c8127b48c483bd5e06b641253f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:01.683463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871935e2-b777-482d-9b45-a404f53c8372 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.683746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871935e2-b777-482d-9b45-a404f53c8372 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.684020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871935e2-b777-482d-9b45-a404f53c8372 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.685421 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 280/569] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:01.686424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb43724-97e0-409d-aee5-dc4115b6a2a7 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.686858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb43724-97e0-409d-aee5-dc4115b6a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.687273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb43724-97e0-409d-aee5-dc4115b6a2a7 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.688871 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 281/570] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:01.693702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb43724-97e0-409d-aee5-dc4115b6a2a7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.710304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.780486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8055a8-be83-44c5-8950-76fa9f4b9135 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.818952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb43724-97e0-409d-aee5-dc4115b6a2a7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.820879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.821832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.822112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.822387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.823129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:01.823434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.824861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b03e-b833-4912-98f4-836d734b69c5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.840228 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 290/571] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:01.846459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.846771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.847054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.863215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.864113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.864395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.864665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.867487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:01.869179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.877406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.878858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b8cd0221-873c-48e9-80a5-a419c4de815c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:01.898444 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:01.899336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:01.900272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:01.900272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:01.900272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:01.900272 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:01.900272 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 282/572] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:01.901074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.901222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.901546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.906691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.921496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:01.923179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.946421 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 291/573] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:01.947296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.985745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.001959 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 283/574] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:02.003024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.068096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe29ac-16ce-4c0f-bb6f-03e817e4402d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.104545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.105620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.105903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.106180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] PATH_INFO: `/v3/users/nova` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.113693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.114429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd281bd0-8558-4ce0-b1c6-5a6d8465db89 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.115163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:02.131468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:02.132431 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:02.133378 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 292/575] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:02.133948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.151534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.158475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.159156 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.159442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.159721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.160446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:02.160754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.162143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.175320 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 284/576] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:02.176166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.237758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.248339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22009c3-0c30-45e0-87d3-16a23ba18ead None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.285949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3961d-9029-4693-987a-c598e923ebd6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.286510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.286765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.287045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.287325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.298137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:02.305789 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:02.306801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:02.307693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:02.311841 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 293/577] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:02.312653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.324609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.325363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.325646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.325920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.342999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:02.350970 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:02.352177 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 285/578] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:02.353424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.413094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.436187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94fb3f-598f-4b62-8f7f-fe2f8d7046d3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.470445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb24e-e118-42ea-8495-f062b1c8fc9c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.475972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.476874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.477482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.477758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.478592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:02.478898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.480812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.503449 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 294/579] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:02.504389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.510769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.511574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.511854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.512129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.517685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.519886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.521546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:02.537776 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:02.538647 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:02.539507 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 286/580] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:02.540065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.615945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d991ec-b5e9-45f3-b36f-cad4c1cc1c94 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.653489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.654148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.654374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14062300-f7f6-435c-9699-265e335b6479 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.654486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.654685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.655664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:02.655996 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.657505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.670270 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 295/581] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:02.670270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.674722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.699829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.700490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.700772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.701053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.701819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:02.702154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.703728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.717126 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 287/582] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:02.718363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.748169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.779394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaf35-cab7-471a-a6d6-03f631355e17 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.814983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.815791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.816073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.816347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.827667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.829180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.833285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314038d4-aec9-4759-955d-9ae38e986102 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:02.847028 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:02.848101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:02.849265 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:02.849265 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:02.849265 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:02.849265 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:02.852816 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 296/583] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:02.853691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.878543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.879129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.879410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.879870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.880661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:02.880971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.882432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.899847 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 288/584] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:02.899847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.934402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.970813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cef18-fa7d-42ff-86c3-d247f34119bf None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.995179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.005122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3b33-59ff-459a-9ce5-7393c25daa8a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.008420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.009230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.009508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.009777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.021379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.022836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:03.041527 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:03.042462 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:03.043321 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:03.043321 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:03.043321 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:03.043321 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:03.043321 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 297/585] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:03.043621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.047152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.048005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.048290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.048567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.059023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.060467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:03.079264 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:03.080168 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:03.081048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:03.081048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:03.081048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:03.081048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:03.081048 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 289/586] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:03.081374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.159777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667734-447b-4220-add5-407b4e6012d1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.175106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.191867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d587c-95b0-4372-b2cc-94dc760233e2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.199988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.200655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.200941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.201250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.201975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:03.202386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.204067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.220985 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 298/587] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:03.220985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.232898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.234668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.235115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.235400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/1f50c773fb0c4b1bb1da7133725f7d7f/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.251667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=1f50c773fb0c4b1bb1da7133725f7d7f, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.253177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.262556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.269466 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 290/588] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:03 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/1f50c773fb0c4b1bb1da7133725f7d7f/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:03.270465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.346980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c6c2-92a3-400e-9fd0-87e1fad3437a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.395881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.396851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.397160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.397447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.398196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:03.398507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.400463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.421874 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 299/589] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:03.422854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.424306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc7500-dfa0-48a9-8d2a-dece00259ce8 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.479110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.480068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.480353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.480631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.481794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:03.482160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.484175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.487165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.502062 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 291/590] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:03.502062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.580511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.590907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967ec8-51dd-4a06-a140-458d10410733 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.630491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.631397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.631685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.631965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.636131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe54d8-84e8-4030-bd9a-0409098e613a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.639703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.640952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:03.657249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:03.658172 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 300/591] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:03.659619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.685080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.687347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.688053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.689291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.701122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.702959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:03.723430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:03.724382 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:34:03.725369 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:03.726872 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 292/592] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:03.727599 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.791530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae471-b286-4252-8bb9-bde939634991 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.791753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.841657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.842594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.843182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.843469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.850455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e166cb-4cf6-49fd-b697-256a41d84958 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.852445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.855421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:03.876575 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:03.877597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:34:03.878491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:03.881281 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 301/593] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:03.882597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.900158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.900880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.901250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.901544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.902438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:03.902752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.904286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.906631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.924964 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 293/594] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:03.925910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.997315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e8ead-c333-4514-9f71-23c9c6171d6a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.034072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801e28f-2b3c-497b-8056-58fc95634fe4 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.035302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.036076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.036483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.036758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.037631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:04.037939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.039487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.054173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.059738 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 302/595] 10.222.0.45 () {56 vars in 1137 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:04.065015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.074131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.074893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.075242 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.075558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.076408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:04.076715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.078710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b579b8-b56d-428a-a1b0-c9de5790c135 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.097046 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 294/596] 10.222.0.45 () {56 vars in 1139 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:04.098406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcdfa0-884c-4412-b625-b96d0984f3e8 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.098697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcdfa0-884c-4412-b625-b96d0984f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.098977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcdfa0-884c-4412-b625-b96d0984f3e8 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.104562 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 295/597] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:04.104562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcdfa0-884c-4412-b625-b96d0984f3e8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.158171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.184034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555ad25-f8e9-45b2-acc7-6b9682135bed None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.214551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcdfa0-884c-4412-b625-b96d0984f3e8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.219628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.220502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.220784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.221059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/e8c5ebd15be54c6badb07f37d58bda07/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.235762 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=e8c5ebd15be54c6badb07f37d58bda07, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.237657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.250916 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 303/598] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:04 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/e8c5ebd15be54c6badb07f37d58bda07/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:04.251629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.254812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.255630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.255902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.256232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.277575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.279446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b2fdc57c-373c-4dce-bddf-51c069a130a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:04.300282 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:04.301510 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:04.302449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:04.302449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:04.302449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:04.302449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:04.304673 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 296/599] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:04.306473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.306984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.307456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.327390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:04.328997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.361660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.401368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7add-4a3b-4524-a16d-f17cdc8e2f83 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.425277 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 297/600] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:04.426516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.435790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.459425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.460515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.460801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.461076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.480411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.481962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:04.503516 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:04.504407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:04.505716 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:04.505716 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:04.505716 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:04.505716 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:04.505716 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 304/601] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:04.506035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.577771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123983-3bd0-4058-9e8f-650bd99046e5 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.617871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ae3c-f6de-44e2-ace9-91393e7ce3f4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.623352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.624111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.624467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.624798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.625562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:04.626419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.628259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.645254 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 298/602] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:04.646135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.659938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.660761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.661076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.661401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.673371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:04.673949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:04.682101 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:04.683043 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:04.684288 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 305/603] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:04.684976 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.729082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.778655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3631b-24ca-491c-bae4-9411ea3913c9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.810494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d35fe-be69-4ca9-be90-91cc349a814a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.825167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.825167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.825167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.825167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.825563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:04.825563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.825563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.841395 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 299/604] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:04.842288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.856137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.857236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.857527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.857809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.868213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.870388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:04.894717 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:04.895645 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:04.896848 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:04.901150 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 306/605] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:04.902525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.936378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.962956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22253027-cede-421b-8bca-a6c1d9b81537 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.000845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.001770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.002088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.002467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.003326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:05.003740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.005245 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.014499 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 300/606] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:05.015834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.024888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.034492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca364-dafa-4253-814b-8835a8c2a73e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.073536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.074585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.075016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.075482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.084017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.085902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:05.102024 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:05.102944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:05.103801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:05.106704 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 307/607] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:05.107717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.132450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22d5fe-ca9f-48ad-a746-d67f56d33c33 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.168973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.169696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.169981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.170321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.171350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:05.171677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.173294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.181134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.193338 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 301/608] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:05.193338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.233104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b75632-d8be-4b00-bab3-f3e130286aba None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.272936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.273530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.274012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.286250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.288091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.299836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3967-392f-4e78-b6e0-017e36bce206 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:05.307742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:05.308620 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:05.309503 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:05.309503 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:05.309503 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:05.309503 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:05.311867 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 308/609] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:05.312927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.326111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.336907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.337614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.337899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.338224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.339019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:05.339333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.340817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.357434 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 302/610] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:05.358833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.425233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.439624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59c46e-d8a5-433a-acc6-43efa6ab7b13 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.472204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a6431-5b6c-4421-823a-72e5a11e127b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.480250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.481665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.482178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.482662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/ae6a98bfbada4666852398c78efce936/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.501358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=ae6a98bfbada4666852398c78efce936, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.503382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.511013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.511768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.512048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.514111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.514111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:05.514111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.514852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.533333 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 303/612] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:05.533333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.533795 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 309/612] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:05 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/ae6a98bfbada4666852398c78efce936/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:05.535000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.629811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.659017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce11259-4d79-462c-9a2c-df01b9f9cfb2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.678858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.679504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a2afa-ccfd-4661-87d6-05cd707b914e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.698667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ead5-c967-4f44-9e48-c3af6df7726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.699948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ead5-c967-4f44-9e48-c3af6df7726b None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.699948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ead5-c967-4f44-9e48-c3af6df7726b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.700145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ead5-c967-4f44-9e48-c3af6df7726b None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/65f0216a9bf54212a72d41ce9f6cc01c/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.716895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ead5-c967-4f44-9e48-c3af6df7726b None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=65f0216a9bf54212a72d41ce9f6cc01c, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.719593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ead5-c967-4f44-9e48-c3af6df7726b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.725391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.726531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.726946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.727164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.736507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.737889 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 304/613] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:05 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/65f0216a9bf54212a72d41ce9f6cc01c/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:05.738035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.740013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a6ae2-befc-46a0-ad3f-19d8f7c5ecfc None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.740640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a6ae2-befc-46a0-ad3f-19d8f7c5ecfc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.741125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a6ae2-befc-46a0-ad3f-19d8f7c5ecfc None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.747405 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 305/614] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:05.749848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.750476 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.750979 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:05.755072 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:05.756065 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:05.756997 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 310/615] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:05.762881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.797851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:05.799067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:05.907215 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 306/616] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:05.912700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08759-4c43-4918-8226-e82ac53dfba8 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.933778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.933972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.954113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.954794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.955084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.955365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.956219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:05.956531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.958018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.981503 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 311/617] 10.222.0.45 () {56 vars in 1135 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:05.986988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.074622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.080858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f782427-7a4d-492b-bdff-ee6a9fbcbfcd None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.125477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.126649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.127130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.127601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.138365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e808-80a8-47a3-9002-15f1c0e611cb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.142406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:06.151448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:06.152383 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:06.153199 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:06.161310 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 307/618] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:06.163758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.223314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.224117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.224664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.224773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.250428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.251986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.284772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e237-6dea-4987-9739-319d2ad1741b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:06.285666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:06.286530 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:06.287381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:06.287381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:06.287381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:06.287381 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:06.287381 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 312/619] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:06.292413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.329806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.330868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.331730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.332420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.333420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:06.334718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.336428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.341495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.355724 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 308/620] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:06.366180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.430729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f408a-93b9-4b5f-bf7a-8aa52da0be8c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.441378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.476636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.477938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.478361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.478776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.479905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:06.480365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.481899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.494950 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 313/621] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:06.503144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.618898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515ff4a-b805-4928-ae42-be2fbea2aeeb None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.668089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.688541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.689297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.689587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.689871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.692603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2995ba-dc15-4147-a8c3-c8a1f44e2669 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.710002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.711466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:06.741676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:06.742711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:06.743570 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:06.743570 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:06.743570 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:06.743570 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:06.743570 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 309/622] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:06.751609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.758051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.758847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.759129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.759406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.770580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.772933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-8004bbb9-c1ef-4201-880d-86a4fbe91c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:06.790225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:06.791207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:06.792154 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 314/623] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:06.793101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc28f0-7c60-45bd-8b23-c3904f25b79a None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.793352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc28f0-7c60-45bd-8b23-c3904f25b79a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.793634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc28f0-7c60-45bd-8b23-c3904f25b79a None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.795015 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 315/624] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:06.800958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc28f0-7c60-45bd-8b23-c3904f25b79a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.839139 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.881084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1932-5375-4391-8bfa-853a70d6bd87 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.915834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc28f0-7c60-45bd-8b23-c3904f25b79a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.923453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.924115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.924820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.925108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.925860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:06.926169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.928217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ec894-8f6a-4ca7-bc5b-edc235ff0f33 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.945304 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 310/625] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:06.946561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.946848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.947125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.958093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.958788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.959065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.959335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.960374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:06.960681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.962203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.966761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:06.968304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.975487 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 316/626] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:06.976366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.989454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.063390 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 311/627] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:07.064944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.091332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9091-7cbf-4d2d-9f31-79411c6f5125 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.135319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.136482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.137514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.138001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] PATH_INFO: `/v3/users/glance` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.146626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.152675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.154597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:07.170404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:07.171967 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 12:34:07.172997 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:07.176665 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 317/628] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:07.177706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.204005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29f84-a909-4618-acf0-5bb075ff2851 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.253889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.255655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.256923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.257374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.259579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/5a9ea8c8127b48c483bd5e06b641253f/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.282195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=5a9ea8c8127b48c483bd5e06b641253f, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.284796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.296557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba42c-23ff-41e1-8c36-4742126d1532 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.304700 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 312/629] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:07 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/5a9ea8c8127b48c483bd5e06b641253f/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:07.305838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.338323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.339323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.339659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.339943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.356195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:07.365719 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:07.366947 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:07.367889 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 318/630] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:07.372857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.446528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b535e-0ecb-4b94-950a-13cf120387a7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.465766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.489042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146728-2197-4f53-882b-c764f57090f2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.499952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.501034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.501491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.501943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.502954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:07.503412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.505020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.528740 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 313/631] 10.222.0.45 () {56 vars in 1137 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:07.534879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.549832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.563447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.564128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.564410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.564688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.565478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:07.565787 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.567174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.578309 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 319/632] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:07.584679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.684867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa455ac-38d6-4251-a275-b7e1dabc8265 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.706392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0691f-bb62-45f3-9b83-54074aa0b6ea None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.722979 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.723863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.724346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.724786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.744722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.745955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.746361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.746797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.763205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.766531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.771189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:07.791244 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:07.792205 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:07.793430 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:07.793430 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:07.793430 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:07.793430 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:07.793430 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 320/633] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:07.803470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.810758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.812500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.869554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.945938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d61a54-fede-4a8a-a985-0cb2e7c4f950 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.948689 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 314/634] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:07.955637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.984102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.984698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.984986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.985300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.986030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:07.986340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.988162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.001731 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 321/635] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:08.007082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.043291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.101779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eeed2-ea97-4f65-a451-1cfb19eb7e17 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.118208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c4b1-b415-4cb5-95fe-3fb2082b7b73 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.120288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.158080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.159343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.159834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.160364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.168365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.170297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.170572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.171528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.171810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.172090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:08.187801 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:08.188786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:08.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:08.191655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.192557 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 322/636] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:08.197357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.198741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:08.231470 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:08.232522 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:08.233479 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:08.233479 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:08.233479 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:08.233479 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:08.233479 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 315/637] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:08.238917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.312552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57091-5f79-427b-a8fb-c9e7311c7d45 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.356031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395691-f350-4a3b-989a-631931001040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.357076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395691-f350-4a3b-989a-631931001040 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.357529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395691-f350-4a3b-989a-631931001040 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.357958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395691-f350-4a3b-989a-631931001040 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.359015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395691-f350-4a3b-989a-631931001040 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:08.359486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395691-f350-4a3b-989a-631931001040 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.361091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395691-f350-4a3b-989a-631931001040 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.380264 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 323/638] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:08.385913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395691-f350-4a3b-989a-631931001040 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.420032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.476759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75bf06-8f4c-49ad-aeb9-616db267c7e0 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.500544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395691-f350-4a3b-989a-631931001040 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.501373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.515733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.516141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.516427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.516708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.517487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:08.517802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.519235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982f3b-5775-469e-8751-9244861f3e52 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.531325 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 316/639] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:08.532669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d912d-8176-4509-833d-f41dc18a634f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.532961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d912d-8176-4509-833d-f41dc18a634f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.533268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d912d-8176-4509-833d-f41dc18a634f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.538615 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 317/640] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:08.539452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d912d-8176-4509-833d-f41dc18a634f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.543458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b78e3-268f-49b9-905f-47e72bb200ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.544362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b78e3-268f-49b9-905f-47e72bb200ef None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.544831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b78e3-268f-49b9-905f-47e72bb200ef None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.545328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b78e3-268f-49b9-905f-47e72bb200ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.621173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b78e3-268f-49b9-905f-47e72bb200ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.622636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b78e3-268f-49b9-905f-47e72bb200ef None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.647657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.648535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d912d-8176-4509-833d-f41dc18a634f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.685195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.686090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.686522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.686841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.694309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.695842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-187e1e96-de81-4bec-aa88-9f7d4ee879c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:08.710267 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:08.711396 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:08.712443 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 318/641] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:08.712961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.713278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.713558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.730895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:08.732088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.743645 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 324/642] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:08.745401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a6c1-0e44-4130-b05d-db19dc67c6bd None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.745861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a6c1-0e44-4130-b05d-db19dc67c6bd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.746285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a6c1-0e44-4130-b05d-db19dc67c6bd None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.747841 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 325/643] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:08.749163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a6c1-0e44-4130-b05d-db19dc67c6bd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.779173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.817973 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 319/644] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:08.818877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.872963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a6c1-0e44-4130-b05d-db19dc67c6bd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.894874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.913527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.914188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.914462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.914735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.915516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:08.915824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.917284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067e085-9fe2-4b40-bd34-33ff58ecec23 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.934680 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 326/645] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:08.934869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfcea3-33c0-48a4-8c18-5ebe2a48a203 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.934965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.934965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.934965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.950845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:08.952074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.973426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.974344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.974630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.974910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.986572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.988011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:09.008273 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:09.009214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:09.010305 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:09.010305 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:09.010305 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:09.010305 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:09.010305 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 320/646] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:09.010305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.025546 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 327/647] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:09.026387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.044511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.120846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e303-aff2-4cea-9325-4f2706a5e66d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.145189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9803-a738-41e2-a6b4-2cc7af35f313 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.157297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.166848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.168078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.168360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.168921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.181260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.181997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.182260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.182460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.182728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:09.183285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=1f50c773fb0c4b1bb1da7133725f7d7f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:09.183596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.185036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.197400 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 328/648] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/role_assignments?user.id=1f50c773fb0c4b1bb1da7133725f7d7f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:09.197400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:09.197729 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:09.198620 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:09.199548 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 321/649] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:09.200223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.315108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.338807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c1d1-e70a-4c23-92e2-325ad68e0d85 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.350339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58e0a-9f72-4d90-8352-1bbce503cd7d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.382322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.383144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.383433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.383714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.396557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:09.400302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.401181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.401610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.402021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.402898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:09.403351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.404907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:09.406538 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:09.407603 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:09.408472 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 322/650] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:09.409130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.422592 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 329/651] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:09.424240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.475969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.543470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab285bb-e53c-4775-a79d-be1330e880c9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.556215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06e19-c8cf-433e-b7ba-089b089214ea None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.590874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.591631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.591937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.592217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.594377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:09.594709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.596221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.596345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.597253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.597734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.598220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.599160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:09.599659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.601329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.606388 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 323/652] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:09.608005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.611243 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 330/653] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:09.616391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.618165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.732926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b756-0064-45fe-b39d-07954e2aaf6f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.744190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b910a-a571-4ab4-9c15-2a4f268e740f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.757489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.776740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.777998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.778726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.779289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.788469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.790137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.790628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.791697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.792082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.792715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.805668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.807269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:09.808669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:09.809617 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:09.810455 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:09.817758 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 324/654] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:09.818808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:09.831388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:09.832306 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:09.833216 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:09.833216 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:09.833216 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:09.833216 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:09.833216 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 331/655] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:09.839045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.901842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.940733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27bee5-680e-4797-9b57-985af2664b6d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.950270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661944d-6234-44c1-b1cf-20e880a9eba0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.978834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.980134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.980418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.980855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.987110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.987765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.988042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.988322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.989095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:09.989430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.990903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.992184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.993686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.008370 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 332/656] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.009244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-82d6d2a1-c124-4fba-a308-bc105915a607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:10.012559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:10.013433 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:10.014862 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:10.014862 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:10.014862 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:10.014862 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:10.018720 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 325/657] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:10.020339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92207-877d-4ce3-bac7-87a68effb939 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.020635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92207-877d-4ce3-bac7-87a68effb939 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.020914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92207-877d-4ce3-bac7-87a68effb939 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.022227 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 326/658] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:10.022932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92207-877d-4ce3-bac7-87a68effb939 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.025655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.126426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744473-392e-4e75-9017-25a313d2a31e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.139809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92207-877d-4ce3-bac7-87a68effb939 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.158252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.167426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.168353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.168877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.169197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.169946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:10.170260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.171913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.178366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.179498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.179787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.180068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.181390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=e8c5ebd15be54c6badb07f37d58bda07) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:10.181859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.183298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf86cd0-5a49-446a-9121-50de0bf3eb63 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.188477 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 333/659] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.188477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.190361 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 327/660] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/role_assignments?user.id=e8c5ebd15be54c6badb07f37d58bda07&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.191621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.191937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.192196 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.214082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:10.215319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.292517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.308637 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 328/661] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:10.308637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.364438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f751-c501-4ce2-bc01-bcdf85b14fb4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.410342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.410939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.411269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.411484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.412242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:10.412556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.414003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.433329 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 334/662] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.434518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.459790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9850a3-f719-4b29-a36c-aff56f7f5eb0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.476615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.505842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.506650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.506931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.507208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.517025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.518618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:10.533734 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:10.534927 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:34:10.536038 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:10.537363 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 329/663] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:10.538373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.571030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec33ba-c92e-4a83-ab08-4667cb67ab93 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.610534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.622183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.622986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.623266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.623620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.638373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:10.649913 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:10.650914 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:10.651709 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:10.652345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fc3f6-1079-4c50-86ca-2180c9c0e340 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.654486 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 335/664] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:10.654486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.693959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.694741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.695030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.695361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.703623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.705130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:10.720939 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:10.723169 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 330/665] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:10.725508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.766562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.782789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794c6e1-79e9-48de-99f5-0ff1163b8f59 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.819202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.820021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.820427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.820807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.821879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:10.822295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.823962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.843131 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 336/666] 10.222.0.45 () {56 vars in 1137 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.844118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.862132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb2303-e3d2-479c-946b-1fe86ce43bea None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.901110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.911236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.912188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.912877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.913190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.914305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:10.914618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.916657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.929016 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 331/667] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.929893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.965370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9279a-bb7d-4183-afc7-f0fe12831245 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.005450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.006131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.006416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.006697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.007539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:11.007852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.009512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.032847 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 337/668] 10.222.0.45 () {56 vars in 1139 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:11.034779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.062972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.072158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a696f4a-d920-49a9-9ec4-dc24252649d0 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.112119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.113246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.113544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.113827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.168610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc0e6-a083-4c9f-9a91-42dab84b67bb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.172957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.210582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.212211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.214600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.215717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.216145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.216585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.228544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.230746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:11.255785 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:11.256730 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:11.258023 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:11.258023 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:11.258023 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:11.258023 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:11.258023 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 338/669] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:11.261400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.322947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.333201 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 332/670] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:11.334304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.392126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a111b-8834-4055-9ef7-2dffad3612de None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.430097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.430782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.431070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.431348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.446448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67239-008d-40e8-a5c8-11097a4b4a41 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.461634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.487642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.488704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.489293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.489773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.490698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:11.491205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.492775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.510562 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 333/671] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:11.511263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.512009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.512921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.571789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.621786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f071-3da5-400e-ba19-37f08121ffce None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.626153 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 339/672] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:11.626820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.660990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.662167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.662691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.663050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.674323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.676185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.685664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:11.693763 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:11.694706 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:11.695563 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:11.695563 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:11.695563 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:11.695563 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:11.695563 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 334/673] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:11.695836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.741798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251cf1e-0e2b-4a22-9b30-fb3723db958e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.778113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.779208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.779710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.780225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] PATH_INFO: `/v3/users/swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.787649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.789392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.803522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0bc58-e9b7-4f14-95b3-17afb7ea6eb2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-33a6c9e7-9acc-4676-9a3b-1b78bf1af8be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:11.804529 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:11.805494 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:11.806386 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:11.808566 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 340/674] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:11.809969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc80f-b087-4632-9b58-3fde32b985af None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.810386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc80f-b087-4632-9b58-3fde32b985af None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.810804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc80f-b087-4632-9b58-3fde32b985af None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.812933 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 341/675] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:11.814525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.817564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbc80f-b087-4632-9b58-3fde32b985af None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.844525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.845361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.845650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.845929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.857220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.858722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:11.876790 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:11.877844 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:11.878745 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:11.878745 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:11.878745 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:11.878745 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:11.878745 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 335/676] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:11.879139 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.937073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbc80f-b087-4632-9b58-3fde32b985af None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.955314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.976144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.977068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.977553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.978077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.979061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:11.979781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.981453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931600f-07c2-49b7-9705-21c73dff1d1e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.984682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeaff2-c8b4-49ab-9748-e60c2b2e5fa1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.994146 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 342/677] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:11.995739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.996028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.996305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.014261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.015869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.026742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.027745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.028032 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.028458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.029348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.029719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.031185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.055293 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 336/678] 10.222.0.45 () {56 vars in 1135 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.055293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.073819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.097178 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 343/679] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:12.097178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.173999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20578ef8-bca0-4cf5-825b-7724b0114873 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.206243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67098c-706d-4b16-81d1-31a4ff1c5124 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.210734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.211584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.212021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.212448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.213362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.213816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.214367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.217410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.235032 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 337/680] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.236111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.245644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.246418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.246698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.247333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.254960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.256689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:12.271769 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:12.272653 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:12.273579 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 344/681] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:12.274062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.322694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.354050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf921-7291-4e81-922f-2b82bd236235 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.390562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3091-bac2-478c-819a-910ec72ea6f2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.391511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.392181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.392459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.392739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.429092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.430174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.430559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.430934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.442804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.444537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:12.463379 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:12.464543 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:12.465666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:12.465666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:12.465666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:12.465666 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:12.465941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.465941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.467100 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 345/682] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:12.468023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.489697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.551685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.578898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 338/683] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:12.579814 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.590026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91274ff6-ec2a-4b7c-9f45-9d4b7c425227 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.631037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.631821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.632096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.632364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.639076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.641273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:12.655398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:12.656426 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 346/684] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:12.662088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.680214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7181389-3490-41b1-87d6-8de1542c2808 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.714937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.715601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.715888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.716171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.716966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.717331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.718914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b4f3c-16a9-459a-8da2-3f4e0da3af0d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.730782 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 339/685] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.732013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa90c6-8fd6-494b-a0e5-33177e7e27af None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.732300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa90c6-8fd6-494b-a0e5-33177e7e27af None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.732583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa90c6-8fd6-494b-a0e5-33177e7e27af None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.734479 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 340/686] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:12.734593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa90c6-8fd6-494b-a0e5-33177e7e27af None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.745095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.767901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d362-a312-4f4f-ac3f-e54c4ad7fafe None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.771708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.802166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.802757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.803037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.803315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.804041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.804333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.805776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.817548 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 347/687] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.818353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.838403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa90c6-8fd6-494b-a0e5-33177e7e27af None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.871948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.872812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.873090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.873389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.884640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.886121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:12.903022 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:12.904061 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:12.905082 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:12.905082 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:12.905082 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:12.905082 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:12.905082 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 341/688] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:12.905082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.924576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c67a-f476-4ddc-a621-ae2f6e06d19b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.959230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.959914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.960227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.960512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.961305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.961614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.963093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99026e04-163a-4d16-a5a8-5a13703f01c8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.971015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.977648 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 348/689] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.978880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.979174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.979699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.993040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.997196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.998396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.005785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d1cfe-f171-49d4-92a6-201cb448e91e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.040905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.041590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.041882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.042166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.043000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=ae6a98bfbada4666852398c78efce936) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:13.043317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.044749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.051196 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 342/690] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/role_assignments?user.id=ae6a98bfbada4666852398c78efce936&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:13.051968 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.066451 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 349/691] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:13.067254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.187015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd6cf-60d0-485f-be89-9c1e29bf285b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.189264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157dfda-e98e-4ac8-8dbb-7182f9b265c5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.218042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.226786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.227473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.227760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.227860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.228050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.228525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.228772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.228868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.229076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.230100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:13.230412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.230504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.231909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.248147 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 350/692] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:13.249511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.257518 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 343/693] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:13.257518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.271283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.395995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b28962-7f3c-494c-b566-ab591ca453b2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.397269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549da88-8dfd-4696-93e1-16206544e7a9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.441410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.442225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.442511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.442792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.445446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.446760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.447199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.447626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.448934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=65f0216a9bf54212a72d41ce9f6cc01c) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:13.449448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.451804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.455348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:13.460210 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 351/694] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/role_assignments?user.id=65f0216a9bf54212a72d41ce9f6cc01c&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:13.460815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:13.464607 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:13.465767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:13.466785 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:13.468890 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 344/695] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:13.474471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.530595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.574304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.596931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee39462-d4fa-4822-ae62-da04e2ff449c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.616840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05064d-bd45-488e-bcf5-7e18bafb1ec9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.646761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.648266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.648904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.649367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.660679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecb060-8af7-4288-b649-628604604112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.661090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.661566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb060-8af7-4288-b649-628604604112 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.661930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb060-8af7-4288-b649-628604604112 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.662284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb060-8af7-4288-b649-628604604112 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.663366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.664391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecb060-8af7-4288-b649-628604604112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:13.664888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecb060-8af7-4288-b649-628604604112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.666395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecb060-8af7-4288-b649-628604604112 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.679773 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 345/696] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:13.685855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecb060-8af7-4288-b649-628604604112 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:13.687458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:13.688489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:13.689510 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 352/697] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:13.695535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.803662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecb060-8af7-4288-b649-628604604112 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.834340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc506c14-e093-40e3-8d40-0e75cf84fa1c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.836412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.843963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.844761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.845044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.845406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.852944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.859231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.860925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.879109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.879777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.880116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:13.880315 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:13.882234 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:13.884287 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:13.884287 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:13.884287 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:13.884287 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:13.884774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.884774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:13.884774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.885211 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 346/698] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:13.885296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.889163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.895950 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 353/699] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:13.902470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.088875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07678fe-4fbe-485e-9967-a576d4c9a73c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.101385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea88ba0-5407-4ec7-a926-3418384f3c64 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.152622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.153778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.153778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.153778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.155479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:14.155479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.156939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.159559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.160302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.160679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.161032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.170242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=5a9ea8c8127b48c483bd5e06b641253f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:14.172858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.174545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.175008 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 347/700] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:14.178040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.188398 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 354/701] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/role_assignments?user.id=5a9ea8c8127b48c483bd5e06b641253f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:14.249680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.339558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a15bea-3f3a-433e-b98e-3b75c84ec791 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.403188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.403923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.404211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.404493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.415636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.417130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:14.433826 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:14.434803 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:14.436037 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 348/702] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:14.441034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.497703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.581173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73fa4-e17d-4114-86fd-e6c2ebe29648 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.625971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.626653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.626936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.627258 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.628146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:14.628458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.630013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.648863 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 355/703] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:14.654065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.762236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d022b-96f4-4aa2-8ab5-259808d21917 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.763844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.803387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.804045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.804333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.804615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.879741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.881234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.989624 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 349/704] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:34:14.995138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.122922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.129753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55256d9-a283-40e2-9a85-601970a64f91 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.177458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.178258 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.178543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.178825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.192886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.194395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:15.212856 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:15.213788 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:15.215086 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:15.215086 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:15.215086 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:15.215086 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:15.215086 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 356/705] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:15.219969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.222189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.355345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8385bd-d796-4b4b-926a-32808ad07053 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.394795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.395467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.395753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.396036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.396763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:15.397076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.398473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f692-f46f-4baa-891f-962db8fafb79 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.410396 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 350/706] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:15.415769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.580227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cab73-16a2-4b28-82af-7e3eb51b6bd2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.653965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.655296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.655586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.655870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.663496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5e943-ee84-4c63-a0fc-63fb392de0f6 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.664145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5e943-ee84-4c63-a0fc-63fb392de0f6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.664434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5e943-ee84-4c63-a0fc-63fb392de0f6 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.665821 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 351/707] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:15.668020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.669653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.671009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.671293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.671577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.698912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:15.700121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:15.705909 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:15.706753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:15.707640 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:15.708640 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 357/708] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:15.722648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.760095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.837625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.879556 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 352/709] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:34:15.913436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.028322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2846c2-47c1-4e06-b0e4-a3f59aad651d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.115447 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ab808-9752-4ce2-a79a-5de420911140 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.133879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.134560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.134844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.135126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.135919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:16.136233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.137726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.168473 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 358/710] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:16.171286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.172111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.172394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.173850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.174530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.175973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.178127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:16.204449 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:16.205568 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:16.206454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:16.207888 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 353/711] 10.222.0.45 () {56 vars in 1129 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:16.211593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.315331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.322380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.395716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6430d5-0707-4a9b-acaf-a2b8a27dbc38 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.403392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c283a-ff0c-423f-bc3b-9dee69703be9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.450213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.451661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.452330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.452964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.454190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:16.456147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.458214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead13f-0c07-4e49-9377-ce3afeca7b71 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.463207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.463870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.464151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.464479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.464858 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 354/712] 10.222.0.45 () {56 vars in 1124 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:16.466441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578759-2ee4-41df-aedd-d507423f2dfe None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.466878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578759-2ee4-41df-aedd-d507423f2dfe None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.467891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578759-2ee4-41df-aedd-d507423f2dfe None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.469659 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 355/713] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:16.470685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=e8c5ebd15be54c6badb07f37d58bda07) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:16.471021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.471313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3768a3-4b83-483d-a007-ca339e2a47f0 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.471740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3768a3-4b83-483d-a007-ca339e2a47f0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.472163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3768a3-4b83-483d-a007-ca339e2a47f0 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.472495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3cbc-f0e7-41fa-aa9c-cd238ea3a649 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.474120 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 356/714] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:16.474986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3768a3-4b83-483d-a007-ca339e2a47f0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.491398 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 359/715] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/role_assignments?user.id=e8c5ebd15be54c6badb07f37d58bda07&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:16.491398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d9ae-69b2-4a32-afdf-c45cf5281604 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.491398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d9ae-69b2-4a32-afdf-c45cf5281604 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.491398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d9ae-69b2-4a32-afdf-c45cf5281604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.514295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3661d9ae-69b2-4a32-afdf-c45cf5281604 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:16.515799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3661d9ae-69b2-4a32-afdf-c45cf5281604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.622043 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 360/716] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:16.624540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.624988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.625523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.645898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:16.647370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.718670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3768a3-4b83-483d-a007-ca339e2a47f0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.732593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.757517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.758291 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 361/717] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:16.759125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.778898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.781575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.782259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.782740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.783657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:16.784195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.785962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.795122 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 357/718] 10.222.0.45 () {56 vars in 1124 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:16.797334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.960306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44dbab-a8b4-4ea2-ba4c-33864575f573 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.012061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.012833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.013122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.013419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] PATH_INFO: `/v3/services/network` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.014166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.016546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.053774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2a87-c64b-4655-88a6-de9783a48c67 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:17.056537 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:17.057588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:17.058612 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 362/719] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/services/network => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:17.067365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.152204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.154394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.155195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.155486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.156774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.191416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:17.205304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:17.206283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:17.207087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:17.208278 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 358/720] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:17.216633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.227281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc7e1-e3e7-482c-99a7-8610e420b346 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.316280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.322491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.323175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.323458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.323737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.324451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] RBAC: Adding query filter params (name=network) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:17.324759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.326192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.342354 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 363/721] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:17.350301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.399689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215807-372f-4bee-b986-1c76bbf7993d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.448990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.450106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.450865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.453013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.454067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:17.456287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.457990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.488293 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 359/722] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:17.494127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.603139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97876-a655-4dc1-9229-0143dc634d1b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.637828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.681939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.682899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.683341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.684005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.686392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] RBAC: Adding query filter params (type=network) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:17.688252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.692991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5880e-1d47-435d-84d5-7173b163db45 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.705857 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 364/723] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:17.710301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99e37-b840-4bb7-a4a8-a3b1e98ec640 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.710693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99e37-b840-4bb7-a4a8-a3b1e98ec640 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.711321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99e37-b840-4bb7-a4a8-a3b1e98ec640 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.712914 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 365/724] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:17.718250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74261-3e4c-4cff-9feb-34ef09bf859c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.719934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.720294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.720661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.732236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.759977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:17.764501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.801491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.802269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.802555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.802833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.824722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.827332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:17.873820 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:17.874999 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:17.875878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:17.875878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:17.875878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:17.875878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:17.882066 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 360/725] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:17.883113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.081247 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 366/726] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:34:18.104635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.123109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe26bc-b862-4169-a725-8f4b06266c43 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.226395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3bbe2-a014-4f03-b8c3-dbd3fb3e7129 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.242833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.265987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.266775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.267062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.267342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.268186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:18.268495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.274627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.279090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.279917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.280250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.281982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.300228 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 361/727] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:18.303806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:18.305293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:18.322822 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:18.323821 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:18.324619 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:18.327168 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 367/728] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:18.336657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.351811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.471089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f078-d378-428b-9a08-7a2d68548f87 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.535534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.538015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.539733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.540229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.552203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.554561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.559142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bac7a-9f89-41ad-854c-979f6559237f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.647562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.649174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.649679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.650181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.651168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:18.651673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.653301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.680115 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 368/729] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:18.684590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.771118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:18.794042 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:18.794992 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:18.797394 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 362/730] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:18.810200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.875667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51ff85-ae60-48d8-812c-d0399374fad2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.923057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.924246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.924725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.925219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.948169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.954134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:18.996872 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:18.997849 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:18.999568 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:18.999568 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:18.999568 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:18.999568 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:19.004986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.016951 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 369/731] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:19.024065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.072214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac70f64-8d59-4413-8f3e-52362135cdce None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.142649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.144134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.144618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.145107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.146170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:19.147853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.149534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.192949 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 363/732] 10.222.0.45 () {56 vars in 1149 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:19.198147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.216828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.250058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa95b-8e95-435f-8215-24c4d600c3bd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.316523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.318292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.318582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.318867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.319604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:19.319916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.321386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7671665-4e2c-44c9-ba84-5e1697e84d6b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.359118 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 370/733] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:19.362791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93246b7-c5c1-4ead-b5d7-93ac1f60afbf None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.362791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93246b7-c5c1-4ead-b5d7-93ac1f60afbf None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.362791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93246b7-c5c1-4ead-b5d7-93ac1f60afbf None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.370694 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 371/734] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:19.371673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93246b7-c5c1-4ead-b5d7-93ac1f60afbf None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.423629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6206f-d00d-42ce-a9b6-ca88577e3221 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.493900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a824b6-c847-41f7-9a0a-a73c05cc7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.494989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a824b6-c847-41f7-9a0a-a73c05cc7969 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.498001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a824b6-c847-41f7-9a0a-a73c05cc7969 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.499030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a824b6-c847-41f7-9a0a-a73c05cc7969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.504189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.540240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93246b7-c5c1-4ead-b5d7-93ac1f60afbf None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.598933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.599655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.599933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.600218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] PATH_INFO: `/v3/users/swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.610792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.612327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.616981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a824b6-c847-41f7-9a0a-a73c05cc7969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.618459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a824b6-c847-41f7-9a0a-a73c05cc7969 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-032e6e38-2e03-47e2-84f5-89cb8e76c61a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:19.628245 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:19.629271 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:19.630203 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:19.634383 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 372/735] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:19.635680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.635974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.636252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.648123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.655897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.657259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.754839 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 364/736] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:19.754839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b108-ceae-4d06-8dab-7f0888dbd75f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.755533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b108-ceae-4d06-8dab-7f0888dbd75f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.756081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b108-ceae-4d06-8dab-7f0888dbd75f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.757303 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 373/737] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:19.758211 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 365/738] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:19.758316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.759235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253b108-ceae-4d06-8dab-7f0888dbd75f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.809666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.875466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd91664-bbec-453a-bc0e-389ae6b7aa76 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.890521 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253b108-ceae-4d06-8dab-7f0888dbd75f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.919967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.921493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.922238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.923042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.924279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:19.925063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.927031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda053-19b5-4802-aac1-6e60a28f6191 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.929969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.930548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.930763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.931050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.931560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.943882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.945716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.954101 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 374/739] 10.222.0.45 () {56 vars in 1135 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:19.955783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.956389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.956883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:19.971242 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:19.972207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:19.973101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:19.973101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:19.973101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:19.973101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:19.978043 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 366/740] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:19.978955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.981096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.985042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.072328 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 375/741] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:20.073423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.094132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.112783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00e544-49e6-4f6f-a7fc-28673e88ae95 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.163677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.164732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.165108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.165507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.177701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:20.187079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:20.188069 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:20.188933 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:20.190807 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 367/742] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:20.190807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.240911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51654b2e-811d-4409-af04-e9c907e4e0a4 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.270455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.283845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.284637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.285016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.285517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.310186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d0004-bf93-4997-97d5-1dc3328a74d2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.358289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.359081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.359437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.359785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.360596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:20.360975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.362460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.380633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.382611 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 368/743] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:20.383803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.387681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.398115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.496475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ededdb-78e9-42c4-a7f6-2dfa7bcbceaf None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.503470 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 376/744] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:34:20.503470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.528864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.540983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.541692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.542031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.542314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.543055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.544457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.562731 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 369/745] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:20.563851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.628695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f11c5-d0c8-4dc4-8573-9e07b598c2f6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.659320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.680809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.682007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.682336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.682664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.683513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:20.683830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.685344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03b02f-cf5b-45ac-a3eb-e4724a48bb46 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.701930 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 377/746] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:20.704630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c12bc-00e0-47b6-aa1d-4c21e2f9cbde None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.705588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c12bc-00e0-47b6-aa1d-4c21e2f9cbde None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.706106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c12bc-00e0-47b6-aa1d-4c21e2f9cbde None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.709500 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 378/747] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:20.710539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c12bc-00e0-47b6-aa1d-4c21e2f9cbde None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.719624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e785be-395c-4ada-94d8-6c851e5f1512 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.764363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.765501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.765996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.767364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.776080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.777884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:20.799768 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:20.800673 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:20.801580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:20.802589 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 370/748] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:20.803408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.836081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.866114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c12bc-00e0-47b6-aa1d-4c21e2f9cbde None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.914163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.914959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.915240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.915517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.923192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5117-47af-4572-8fdd-9cd8484ea3a1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.929637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.931266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-07918f87-2036-4aab-b8c2-0ac793ce84ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:20.952532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:20.953733 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:20.954862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:20.954862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:20.954862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:20.954862 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:20.960542 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 379/749] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:20.960542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.960542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.960542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.964894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.972889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.973936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.974387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.975979 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.979160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:20.981100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.993853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.995735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:21.021711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:21.022841 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:21.023703 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:21.023703 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:21.023703 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:21.023703 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:21.023703 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 371/750] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:21.023969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.079954 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 380/751] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:34:21.079954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.164969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.174291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c236e86-7821-439d-95f4-3d52b4995e0f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.220195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0812f1-d29e-41b6-8651-55a7f52beb27 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.221596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.222549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.222801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.223084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.224794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:21.225125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.226609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.246295 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 372/752] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:21.246295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.278645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.280261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.280954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.281972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.283162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:21.283669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.286367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.297958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.301112 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 381/753] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:21.302347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.384824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341944f-7c48-4eaa-9e77-0b1ef6bfcdcc None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.431721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.432448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.432663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.432933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.433688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:21.433992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.436367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.450060 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 373/754] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:21.450820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.462084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c423-6908-4858-ba9b-3f6915418e29 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.490175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.503938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.504642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.504931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.505579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.506131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.507771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.526617 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 382/755] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:21.527949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.591362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.597565 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b487bd-bc68-46c2-be48-2c020feaca60 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.679499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.680269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.680549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.680827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.681746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=9ea2526f970f4d069dd6af31de04e340) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:21.682057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.683533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.686473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d28ae-ab32-4cd8-8b83-a0f043aa1847 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.709371 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 374/756] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/role_assignments?user.id=9ea2526f970f4d069dd6af31de04e340&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:21.710399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.742830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.744034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.744559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.745054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.757417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.760786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:21.784482 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:21.785533 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:21.786423 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:21.787525 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 383/757] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:21.794609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.874528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.951148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfa36d-f603-41fc-8780-92ce715fac99 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.975652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f8ccf-dd27-47e0-a60d-c5bb2fcf3e22 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.007644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.008398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.008677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.008950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.015691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:22.015691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.015691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.039056 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 384/758] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:22.045123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.060392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.061983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.062433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.062861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.079401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.081089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:22.116767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:22.118008 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:22.118944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:22.132123 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 375/759] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:22.133444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.177831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.272231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9852ca7-90f0-4517-9d17-89ab078ea4bd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.275176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.341207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363a6e9-78c9-42da-9770-42dc23543260 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.349915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.350585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.350868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.351146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.351989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=5a9ea8c8127b48c483bd5e06b641253f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:22.352304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.353805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.368887 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 385/760] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/role_assignments?user.id=5a9ea8c8127b48c483bd5e06b641253f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:22.397585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.398280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.398573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.398856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.400104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:22.400419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.405163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.437165 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 376/761] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:22.437627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.646731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a495a-a7fd-4f92-8cfa-a9a11fe8444d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.718824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.720026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.720506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.720981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.746647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.748961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:22.786404 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:22.787348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:22.788334 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:22.788334 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:22.788334 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:22.788334 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:22.791836 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 386/762] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:22.796510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.909008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.933509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0268f-a584-4a86-b274-cde67f029fae None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.972416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.973232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.973518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.973791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.974512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:22.974818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.976185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f3457-ba91-448c-9823-d8b87fef7833 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.000739 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 377/763] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:23.006938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.056549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.159406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cdaf9-f6c4-411b-97ef-a5cd80a8a4df None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.159739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cdaf9-f6c4-411b-97ef-a5cd80a8a4df None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.159969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cdaf9-f6c4-411b-97ef-a5cd80a8a4df None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.162679 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 378/764] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:23.168657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.168953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.169252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.207972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:23.209570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.241960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b85d8-5f88-4c06-a1f3-850984bcb533 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.363506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.364311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.365217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.365217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.390807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.394930 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 379/765] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:23.395389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:23.418890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:23.419930 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:23.421459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:23.425187 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 387/766] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:23.430319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.441168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.577244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.610692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.640921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f600ac-81d4-4ac5-b5c7-a0eb4e572ed6 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.646800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258deb33-588d-4bfd-a136-2a4cdeedc406 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.721250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.721921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.722200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.722473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.723260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:23.723569 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.729415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.729542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.729542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.729835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.730100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.730819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.733733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:23.758285 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:23.759256 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:23.760067 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:23.765164 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 388/767] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:23.766543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.770210 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 380/768] 10.222.0.45 () {56 vars in 1129 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:23.777163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.984912 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ab894-4915-4908-a04a-d8b3a4ba5f22 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.991448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5badc6-c2ed-496b-855a-05d95b3c9ccb None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.049167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.049167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.049167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.049167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.049901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:24.049901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.051293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.067266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.068190 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 389/769] 10.222.0.45 () {56 vars in 1124 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:24.074876 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.094376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.101883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1814f-9f67-4c36-b0f3-169d22aae743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.103026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1814f-9f67-4c36-b0f3-169d22aae743 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.103459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1814f-9f67-4c36-b0f3-169d22aae743 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.103915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1814f-9f67-4c36-b0f3-169d22aae743 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/e8c5ebd15be54c6badb07f37d58bda07/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.118099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1814f-9f67-4c36-b0f3-169d22aae743 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=e8c5ebd15be54c6badb07f37d58bda07, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.119799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1814f-9f67-4c36-b0f3-169d22aae743 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.167662 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 381/770] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:23 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/e8c5ebd15be54c6badb07f37d58bda07/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:24.372466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8e43c-2946-49e9-a3e5-05d608ff1c2d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.441000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3113-44a5-43df-8d06-9ad009d8b850 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.442025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3113-44a5-43df-8d06-9ad009d8b850 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.442515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3113-44a5-43df-8d06-9ad009d8b850 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.444225 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 382/771] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:24.450774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119816-7bcb-4bbb-a597-ae9dadf0ff50 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.459866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119816-7bcb-4bbb-a597-ae9dadf0ff50 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.459866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119816-7bcb-4bbb-a597-ae9dadf0ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.460109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.460109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.460109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.460109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.460708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:24.461171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.465180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.478917 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 390/772] 10.222.0.45 () {56 vars in 1124 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:24.486877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.491083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-98119816-7bcb-4bbb-a597-ae9dadf0ff50 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:24.498553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-98119816-7bcb-4bbb-a597-ae9dadf0ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:24.610856 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 383/773] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:24.631620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.647753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08884-9010-49d8-920c-ce4d578a13da None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.648042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08884-9010-49d8-920c-ce4d578a13da None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.648324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08884-9010-49d8-920c-ce4d578a13da None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.652087 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 384/774] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:24.661434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.661434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.661434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.688245 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:24.689490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:24.696615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667c3b-439e-4142-a8e4-5e3d6b060c31 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.740505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.741610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.742109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.742951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.744066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] RBAC: Adding query filter params (interface=public, service_id=91196720396940f781b2732265538fa5, region_id=RegionOne) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:24.746615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.748358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.767698 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 391/775] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/endpoints?service_id=91196720396940f781b2732265538fa5&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:24.768896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.793000 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 385/776] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:24.793924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.888321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.905823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f274423-0a6b-4f18-ae38-21555f327249 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.943420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.947758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa6fe6-3be8-4f9b-a1e2-1148d3fb1288 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.952696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.954098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.954580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.955045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.968404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:24.977380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:24.978289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:24.979093 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:24.986548 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 392/777] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:24.987759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.003716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.004391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.004678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.004957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.006837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.008285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.021746 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 386/778] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:25.022956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.123960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d3954-8199-445d-a489-7cd5fc556981 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.173525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.174688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.175267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.175743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] PATH_INFO: `/v3/services/network` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.176712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.178405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:25.193502 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:25.194675 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:25.195525 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:25.198667 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 393/779] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:25.213624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.228144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9773f03-ba92-4a7f-a756-19a29b3243ab None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.257551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.275316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.281459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.281459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.281459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.281459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:25.281459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.284003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.301198 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 387/780] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:25.306648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.361946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.425812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9b3d3-34af-448a-97f6-7d52376f2b9d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.445022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215beaaa-c3bb-4481-b488-ed1e62658bd6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.464744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.465466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.465750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.466029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.466743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] RBAC: Adding query filter params (name=network) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:25.467901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.470494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a660aa-e335-4a25-aaba-28a642e25076 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.483076 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 394/781] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:25.484687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074bafa-49f3-43b3-bfc7-6e18c6224850 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.485177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074bafa-49f3-43b3-bfc7-6e18c6224850 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.487889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074bafa-49f3-43b3-bfc7-6e18c6224850 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.490042 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 395/782] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:25.491002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074bafa-49f3-43b3-bfc7-6e18c6224850 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.494985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.502221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.503011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.503875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.524692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.532706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-d087895b-f332-44cb-81da-6545419bb8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:25.556136 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:25.557068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:25.557978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:25.557978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:25.557978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:25.557978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:25.563063 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 388/783] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:25.564645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.565305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.565796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.587632 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:25.589384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:25.618046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.648016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074bafa-49f3-43b3-bfc7-6e18c6224850 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.680247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.692109 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 389/784] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:25.692997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.711511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.713672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.713672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.713672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.713672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] RBAC: Adding query filter params (type=network) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:25.713985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.715124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.726956 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 396/785] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:25.726956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.825944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83decb6-f1b9-4dda-8266-da8074f67fa4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.866262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.867315 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.867825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.868322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.869345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:25.869879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.871456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.885995 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 390/786] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:25.887261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.888510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245499a-3617-4103-bcec-375bb3646ad1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.920768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.950002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.950836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.951019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.951863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.978214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:25.987565 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:25.988521 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:25.989409 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:25.990567 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 397/787] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:25.990957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.019289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d065e-156e-4860-980a-15ea694b4e12 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.065791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.066840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.067405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.067900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.068926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] RBAC: Adding query filter params (interface=public, service_id=db2feb68a7d246418bb8097331197e4e, region_id=RegionOne) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:26.069481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.069948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:26.072344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.082990 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 391/788] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/endpoints?service_id=db2feb68a7d246418bb8097331197e4e&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:26.084179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.160529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eef5-17ec-4919-a4f4-df628f3ec45a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.181709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:26.203561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401723c-ff53-44ec-91d0-73a0d3ec2cb9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.215927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.217049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.217379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.217663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.231752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.234047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.256670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.257767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.259570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.260067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:26.260591 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:26.261610 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:26.262560 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:26.263091 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 398/789] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:26.264202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.264982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:26.265526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.267159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.277818 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 392/790] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:26.278978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.461404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515272d4-2dac-4cd7-bb7e-33317db09f92 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.464136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:26.485845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241bf3-ead7-47b8-bb86-b0396e2fa15f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.505067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.505782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.506255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.506365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.506997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.508380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.515761 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 399/791] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:26.516610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.550595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.552751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.553285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.554708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.556002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:26.556533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.558457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.582655 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 393/792] 10.222.0.45 () {56 vars in 1149 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:26.594557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.605798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:26.642902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea712c1-540d-4714-b51e-939eb302f191 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.688643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.689517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.689856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.690139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.707718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.709616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:26.747445 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:26.749006 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:26.750484 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:26.750484 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:26.750484 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:26.750484 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:26.750484 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 400/793] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:26.756503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.809332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:26.858479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac454-cea8-402b-814b-b44a57efdb93 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.919322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.921734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.921868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.922121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.948035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.948035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.960913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ec27-14ca-4a85-b73c-cdfdc1f0dfc3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2e7569be-f56a-4ffd-bb23-c6c7bbadeeec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:26.973130 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:26.974108 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:26.974978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:26.974978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:26.974978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:26.974978 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:26.975193 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 394/794] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:26.984897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401f07-153f-4a7b-b293-d1deefbe39eb None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.985254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401f07-153f-4a7b-b293-d1deefbe39eb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.987456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401f07-153f-4a7b-b293-d1deefbe39eb None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.989110 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 395/795] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:26.995152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c401f07-153f-4a7b-b293-d1deefbe39eb None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.021234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.021234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.021234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.021234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.025168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:27.025168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.025168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ef3d-c3ea-4358-884e-d9f2839cceb7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.049315 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 401/796] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:27.050702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.050988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.052308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.088785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:27.094422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:27.122802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.195830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c401f07-153f-4a7b-b293-d1deefbe39eb None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.209324 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 402/797] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:27.213170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.237703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.255891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.256573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.257327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.257616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.258354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:27.258663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.260603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.281246 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 396/798] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:27.282470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.427669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879ea9-3235-401e-b8c9-d9a2375bf984 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.490694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9664-66af-4bec-ac4f-c1565ab117fa None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.504226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.505848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.506442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.507055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.517404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.519237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.530773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:27.546387 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:27.547330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:27.548224 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:27.556151 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 403/799] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:27.556151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.582787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.583920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.584307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.584690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.613750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:27.630920 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:27.631991 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:27.632782 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:27.637611 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 397/800] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:27.638495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.661820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.700619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ccb26-d0a1-4f1d-83e9-1d85d6641e8f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.742737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.743896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.744401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.744937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.753003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.754925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:27.771598 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:27.772574 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:27.773694 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:27.780446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b68a9-194f-4d1f-a8f7-64a4fa2b1589 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.780671 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 404/801] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:27.781732 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.824902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.825765 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.826834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.827225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.828189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:27.828609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.830717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5bc06-bd87-4eed-82e2-f4ba28ea04aa None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.859534 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 398/802] 10.222.0.45 () {56 vars in 1135 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:27.859534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eea46-cbd1-4010-aca1-80118baf26c3 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.859534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eea46-cbd1-4010-aca1-80118baf26c3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.859534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eea46-cbd1-4010-aca1-80118baf26c3 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.859534 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 399/803] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:27.861319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eea46-cbd1-4010-aca1-80118baf26c3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.912265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.925627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c825a-77dd-4e9b-8a30-127ede406bb8 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.957975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.972966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.973771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.974062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.974342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.975222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:27.975548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.976938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.992274 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 405/804] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:27.992274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.009921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eea46-cbd1-4010-aca1-80118baf26c3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.057770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.058641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.059030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.059405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.060321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:28.061296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.062893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ad198-94fc-404f-af53-4c175e6fc3af None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.077308 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 400/805] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:28.079026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.079585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.080039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.097859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:28.099312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:28.125573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73613-9c1f-4ae3-a346-47dfdd7b9a3b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.164742 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.165866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.166403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.166873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.182669 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 401/806] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:28.182669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.187374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.188833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:28.210490 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:28.212020 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:28.213077 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:28.213077 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:28.213077 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:28.213077 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:28.214149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:28.216317 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 406/807] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:28.218022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.284200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:28.317170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735802b4-da05-4881-a8e8-b79456503ba0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.353897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493bef-abc0-4e82-8c45-2bfd674dc53c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.372320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.373634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.374330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.374634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.387803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.390607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.399348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.400259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.400534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.400807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/9ea2526f970f4d069dd6af31de04e340/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:28.412231 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:28.413192 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:28.414103 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:28.414103 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:28.414103 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:28.414103 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:28.415869 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 402/808] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:28.416692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.425939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=9ea2526f970f4d069dd6af31de04e340, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.428155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.457184 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 407/809] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:28 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/9ea2526f970f4d069dd6af31de04e340/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:28.457184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.516446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:28.555318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43db58-fb4d-40f0-b386-12ee5a8cdc29 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.634189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:28.642903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.643741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.644029 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.644307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.644987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.646443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.650068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a1e2-76de-4665-b188-8aa09f991ad9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:28.669094 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:28.670207 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:34:28.671026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:28.676954 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 403/810] 10.222.0.45 () {56 vars in 1129 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:28.682802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.709979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.709979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.710249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.710487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.711158 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:28.711465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.712862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.730927 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 408/811] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:28.732242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.822301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d4d9-a78f-4c77-a000-7dda75f5448b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.857700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896073-59e3-4db9-a37e-5dd1adcc0a83 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.868087 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.868769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.869053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.870729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.870729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:28.870729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.871921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.888433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:28.892352 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 404/812] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:28.893404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.916343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.917012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.917395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.917674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.918378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:28.918684 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.920621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.926726 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 409/813] 10.222.0.45 () {56 vars in 1124 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:28.927663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.962133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.040533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a2ed-54c1-423b-9f3b-32db40f97354 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.073921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8fb6a-083b-4ff6-b3cd-58c380052b3e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.089454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.090898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.091392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.092080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.101875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.104483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.121699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.122870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.123462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.124030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:29.124440 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:29.125294 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:29.126205 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 405/814] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:29.127132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.142297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.144141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ff5182d0-01e0-4575-b190-ad9f142edff2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:29.159784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:29.160775 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:34:29.161753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:29.165326 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 410/815] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:34:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:29.167779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560763-d82a-4f0b-9cc0-ff4b9204a8e2 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.168504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560763-d82a-4f0b-9cc0-ff4b9204a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.169085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560763-d82a-4f0b-9cc0-ff4b9204a8e2 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.178681 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 411/816] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:29.180567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560763-d82a-4f0b-9cc0-ff4b9204a8e2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.220160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.289268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1db7-a80e-470f-8443-d7fdab5b091d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.297585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.334646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.334790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560763-d82a-4f0b-9cc0-ff4b9204a8e2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.334870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.335116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.335317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.336053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:29.336347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.337748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.353192 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 406/817] 10.222.0.45 () {56 vars in 1124 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:29.353192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.382738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.383681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.384115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.384565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.385766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:29.386695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.388727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd770-6313-4881-bb02-dec6c9df9c76 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.406442 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 412/818] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:29.408415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.408858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.409317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.430047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:29.431260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.485722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ceab8-9f69-457d-a9be-945892e83e3f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.513464 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 413/819] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:29.514886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.529272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.546130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.547411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.547951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.548559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.549817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:29.550325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.552654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.579912 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 407/820] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:29.579912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.616680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.659790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39560-78a5-41d2-8f85-a8bdf426e490 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.712982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.714286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.715117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.715883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.716885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.718290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.718533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970a96-efc9-4d6b-b6ef-ed4901666272 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.747988 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 414/821] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:29.749489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.810703 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.812562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.813414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.813919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/5a9ea8c8127b48c483bd5e06b641253f/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.821237 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=5a9ea8c8127b48c483bd5e06b641253f, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.822959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.857864 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 408/822] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:29 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/5a9ea8c8127b48c483bd5e06b641253f/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:29.861257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.970865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beb75b-d6b8-4164-a7b2-f60db4b4a657 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.972709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.009817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.040827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.041738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.042124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.042522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] PATH_INFO: `/v3/services/network` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.043335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.045185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:30.066133 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:30.067356 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:34:30.068348 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:30.070796 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 415/823] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/services/network => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:30.077481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.112257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17783-b2ea-4d2e-9075-cbb0f3d707f3 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.168836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.169539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.170919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.171034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.313214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.315602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.350775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3640e4-b164-4434-aa02-36191b558049 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.393522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.449961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.452635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.453230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.453735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.454672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] RBAC: Adding query filter params (name=network) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:30.455203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.456822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.472566 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 416/824] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:30.486868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.545639 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 409/825] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:34:30.551487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.614693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.681415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143dd3b-df6e-46c5-a93c-3b9e04a3a81e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.726517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.727698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.728185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.728673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.739961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.746358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.748877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:30.773500 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:30.774559 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:30.775474 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:30.775474 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:30.775474 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:30.775474 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:30.785315 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 410/826] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:30.787073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.805007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0dde5-7591-4ed7-ab9c-68833540c5bf None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.930152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.931235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.931749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.932240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.933172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:30.934982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.936897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.955912 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 417/827] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:30.957093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.114527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb8fb-d2cb-4899-a2ef-8e4689841547 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.158709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f203bd-9d40-486d-8928-3599052bf7e9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.192322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.222573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.223651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.224151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.224700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.225689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:31.226253 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.227863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc59760-7538-452d-8cba-9ec10ffc73a1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.249843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c0b38-b3b0-4275-b25a-16a769a84895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.250876 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c0b38-b3b0-4275-b25a-16a769a84895 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.251363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c0b38-b3b0-4275-b25a-16a769a84895 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.251859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c0b38-b3b0-4275-b25a-16a769a84895 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.252798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c0b38-b3b0-4275-b25a-16a769a84895 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.254436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c0b38-b3b0-4275-b25a-16a769a84895 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.255744 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 411/828] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:31.258323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42d99-351f-4be3-aa56-2f0801a0b6e4 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.258842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42d99-351f-4be3-aa56-2f0801a0b6e4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.259341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42d99-351f-4be3-aa56-2f0801a0b6e4 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.261095 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 412/829] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:31.267545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42d99-351f-4be3-aa56-2f0801a0b6e4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.288726 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 418/830] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:31.290664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.291216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.291717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.316097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:31.317994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.442554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.567918 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 419/831] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:31.594171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.650009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42d99-351f-4be3-aa56-2f0801a0b6e4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.695034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.695750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.696030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.696303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.703816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.705300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:31.722128 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:31.723080 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:31.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 413/832] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:31.729375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.732308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.737374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b252c3-a75c-4acb-b519-8f6b975fcfc4 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.781617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.783461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.783973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.784513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.799334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:31.811458 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:31.812468 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:34:31.813353 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:31.818447 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 420/833] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:34:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:31.821935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.865644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb3a8-febb-4d5c-b91f-23ee78c33d9c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.880268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.906391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.907056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.907338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.907611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.908400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:31.908720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.910190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.924294 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 414/834] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:31.930203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.950867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70878577-3e36-44a5-85fb-5f0ac8f3548a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.999189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.000424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.001249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.002015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.002989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:32.003567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.005879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.017372 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 421/835] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:32.022267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.049598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.054691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb95db-f941-4997-b6a7-886787cd7f45 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.103800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.104718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.104997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.108832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.110030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=e8c5ebd15be54c6badb07f37d58bda07) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:32.110590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.112847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.122670 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 415/836] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:31 2022] GET /identity/v3/role_assignments?user.id=e8c5ebd15be54c6badb07f37d58bda07&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:32.140257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dba932-7d10-4345-ae70-21dceef3a5e9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.180967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.181814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.182097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.182370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.197069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.198635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-739b8aa2-07e1-40e2-ab5d-f31c55449df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:32.220631 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:32.221646 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:32.222518 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:32.222518 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:32.222518 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:32.222518 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:32.222518 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 422/837] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:32.228625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.271928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.362369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c791-776d-4893-8bdd-2f141c14a05b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.399807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.400470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.400749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.401027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.401779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:32.402088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.403547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.405690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4625b2-b01d-4fca-9dfa-27adf1942002 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.405969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4625b2-b01d-4fca-9dfa-27adf1942002 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.406306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4625b2-b01d-4fca-9dfa-27adf1942002 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.407751 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 423/838] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:32.413167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72259-ddfa-4e3d-ae52-6759fe35de73 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.413475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72259-ddfa-4e3d-ae52-6759fe35de73 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.413752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72259-ddfa-4e3d-ae52-6759fe35de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.421284 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 416/839] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:32.425872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.433005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-23b72259-ddfa-4e3d-ae52-6759fe35de73 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:32.434487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-23b72259-ddfa-4e3d-ae52-6759fe35de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.531262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.532692 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 424/840] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:32.534255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550248a4-ba75-4b7b-83b1-3e56d2c5a358 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.534558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550248a4-ba75-4b7b-83b1-3e56d2c5a358 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.534814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550248a4-ba75-4b7b-83b1-3e56d2c5a358 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.536362 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 425/841] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:32.545189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.545189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.545189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.547152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.550915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ce15a-33d7-4b47-a094-43164101f5c1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.560155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:32.561960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.592479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.593556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.594010 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.594132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.601992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.603446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:32.619448 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:32.620496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:32.621472 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:32.625236 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 417/842] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:32.626136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.637647 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 426/843] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:32.639565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.769774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6989cf-a10d-4dbc-af58-4f7f6da1b052 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.788213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b0e6-9ffd-4898-800a-da07ef00bf2b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.814165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.814973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.815261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.815541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.816228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.818613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.828512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:32.836638 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:32.837717 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:32.838545 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:32.843383 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 418/844] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:32.844252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.844808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.845553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.845892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.846175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.847090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:32.847403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.848862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.869478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.872778 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 427/845] 10.222.0.45 () {56 vars in 1149 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:32.875498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.978223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5afc-de0e-44fc-9115-39a9de61805b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.006976 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f78988-f511-4fca-8cb2-1d1e13b1a449 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.021650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.022449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.022965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.023075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.034256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:33.042175 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:33.043101 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:33.044102 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 419/846] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:33.044903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.051587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.053161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.053466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.053744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.054456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:33.054766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.056142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.062919 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 428/847] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:33.063575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.119108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.139407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.163221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58705977-12a4-461b-b2a4-c086e0f2034d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.166574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a724-e79e-4ec2-8684-06f9616ba9f3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.199963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.201556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.201731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.202226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.202389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.202658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.202934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.203210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.203667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:33.203974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.205399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.213565 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 429/848] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:33.214371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.283179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.284622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.319739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515ab85-d662-4030-9664-4fb4b8f0a400 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.346577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.362068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.362810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.363170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.363517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.364232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:33.364542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.365966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.371097 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 430/849] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:33.371895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.387155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.416212 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 420/850] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:34:33.422632 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.511362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f0e5-bc54-4cb8-89a1-c4c83fb9aed5 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.553855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.554667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.554949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.555227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.556585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e8c53-6f7f-40c8-b19e-51822ddce7b5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.568877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.570636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:33.591772 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:33.592786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:33.593679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:33.593679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:33.593679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:33.593679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:33.593679 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 431/851] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:33.600413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.605277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.606325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.606830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.607839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.618874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.620627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:33.639540 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:33.640445 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:33.641352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:33.641352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:33.641352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:33.641352 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:33.643570 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 421/852] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:33.644874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.648925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.683915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.729801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043380-bf32-4216-a4f1-4adb6157e0ac None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.766990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08293-d3e3-416c-ab7c-02f57178d8bb None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.776052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.776979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.777433 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.777922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.779403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:33.779867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.782184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.801391 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 432/853] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:33.802376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.814007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.814682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.814967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.815245 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.815969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:33.816277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.817780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.830901 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 422/854] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:33.836922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.905902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.916149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59655e4e-51eb-4369-b9fd-043d86ddd715 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.954024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.954824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.955109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.955384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.963095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.964609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.968998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.980355 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412ef8-858b-4d96-b550-9bfd18297f99 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:33.982767 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:33.983683 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:34:33.984613 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:33.988919 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 433/855] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:33.989829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.034497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.035758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.036256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.036726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.048733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.051141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:34.072463 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:34.073428 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:34.074303 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:34.081951 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 423/856] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:34.084300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.125966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd989d-35eb-404c-8091-c9b53a295c48 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.166747 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.167423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.167705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.167983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.169108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:34.169108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.171380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.195443 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 434/857] 10.222.0.45 () {56 vars in 1135 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:34.196348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.209676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.216326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdfc41-38ac-4e64-86c9-ac04ba70c842 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.253960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.254680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.254970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.255250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.256391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:34.256567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.258062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.276075 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 424/858] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:34.277256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.291040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.338884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1062-1222-4045-8e31-13c41213b877 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.382685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.383478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.383891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.384251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.414039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99bf96-4f0a-4d95-b79b-752d1c97fff5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.458315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.460827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.462665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.464408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.464887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.465376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.466378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=9ea2526f970f4d069dd6af31de04e340) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:34.467033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.469532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c6fed-daae-48b0-901b-141ef1768d5c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.475896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.480115 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 425/859] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/role_assignments?user.id=9ea2526f970f4d069dd6af31de04e340&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:34.555050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb13644-6a68-4ae1-b10c-5f42741371f6 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.555377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb13644-6a68-4ae1-b10c-5f42741371f6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.555623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb13644-6a68-4ae1-b10c-5f42741371f6 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.561545 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 426/860] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:34.563608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.563902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.564183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.584595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:34.585747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.588305 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 435/861] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:34:34.594196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.689193 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 427/862] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:34.712117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.717553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.720686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324c47-9ec7-4b3f-8426-b68c8ffa2ccf None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.737399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.768658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.769594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.770618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.770618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.783474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.784939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:34.811320 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:34.812791 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:34.813763 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:34.813763 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:34.813763 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:34.813763 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:34.813763 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 436/863] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:34.819681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.843892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803532-2ee8-4e2e-b2f7-d81abd7d11e1 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.894371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.895733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.896573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.897361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.898205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.900662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:34.917952 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:34.918934 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:34.919868 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:34.922739 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 428/864] 10.222.0.45 () {56 vars in 1132 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:34.928050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.945711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa3ef-9b0b-498b-b82b-81d9eddb3eda None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.983402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.984070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.984354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.984633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.985458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:34.985776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.987328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.000556 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 437/865] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:35.006053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.012387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.032860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.052781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8717b4-9f76-4e65-82ca-e4849ea1610a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.089345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.090306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.090529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.090901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.091888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:35.092642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.094216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.104120 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 429/866] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:35.105209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.119966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e9929-f00e-40db-b956-0eee0437180d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.157195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.158315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.158740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.159168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.166776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.168525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:35.184605 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:35.185812 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:35.186706 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:35.194350 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 438/867] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:35.195502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.219939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0afdd-e4b7-4c97-be4f-cac926876ffa None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.252399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.259446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.260120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.260402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.260678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.261416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:35.261717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.263082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.269309 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 430/868] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:35.290536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.313097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef5f55-3083-42d4-8582-02acf46c8791 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.357874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.358532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.358817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.359103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.359904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:35.360218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.361757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2345e6-e8c1-45de-93b3-bad873a75149 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.376257 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 439/869] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:35.382317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.503901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31243c4-fb44-49fd-88c7-7a59d2b7175e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.540358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.541039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.541360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.541641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.542501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=5a9ea8c8127b48c483bd5e06b641253f) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:35.542815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.544302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f937e0-8e79-4747-a148-19caaf2a3994 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.552201 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 431/870] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:35 2022] GET /identity/v3/role_assignments?user.id=5a9ea8c8127b48c483bd5e06b641253f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:35.777087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97e270-1899-4866-8e0e-3ccc1075c8b2 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.777718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97e270-1899-4866-8e0e-3ccc1075c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.777718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97e270-1899-4866-8e0e-3ccc1075c8b2 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.780138 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 440/871] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:35.786409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdba61a-a05d-43ed-bc3e-c5c97365a54c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.786726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdba61a-a05d-43ed-bc3e-c5c97365a54c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.787137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdba61a-a05d-43ed-bc3e-c5c97365a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.806411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-afdba61a-a05d-43ed-bc3e-c5c97365a54c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:35.807855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-afdba61a-a05d-43ed-bc3e-c5c97365a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:35.879520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.894638 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 432/872] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:35.923487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97e270-1899-4866-8e0e-3ccc1075c8b2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:36.062786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97e270-1899-4866-8e0e-3ccc1075c8b2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:36.099820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25804a-7790-45ab-8810-a809dd3cde0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:36.100490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25804a-7790-45ab-8810-a809dd3cde0e None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.100776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25804a-7790-45ab-8810-a809dd3cde0e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.101085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25804a-7790-45ab-8810-a809dd3cde0e None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.102397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25804a-7790-45ab-8810-a809dd3cde0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:36.104994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25804a-7790-45ab-8810-a809dd3cde0e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:36.121134 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 441/873] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:35 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:36.964094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e17da-e1b1-40f5-bed3-9786edce0d50 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.964655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e17da-e1b1-40f5-bed3-9786edce0d50 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.964655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e17da-e1b1-40f5-bed3-9786edce0d50 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.966285 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 433/874] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:36.972058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.972998 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.973543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.979084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:36.995082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:36.996749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:37.081841 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 442/875] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:37.106826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e17da-e1b1-40f5-bed3-9786edce0d50 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:37.213250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e17da-e1b1-40f5-bed3-9786edce0d50 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:37.249961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:37.250690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.250970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.251241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.261863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:37.270048 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:37.271152 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:37.272238 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:37.277377 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 434/876] 10.222.0.45 () {56 vars in 1120 bytes} [Mon May 23 12:34:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:37.279009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:37.391939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaead2-784b-4aab-b1f7-82161d3c9c63 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:37.423408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:37.431970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:37.432648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.432935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.433252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.434007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:37.434320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:37.436013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:37.445275 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 443/877] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:34:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:37.451304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:37.510475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:37.571455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16cbbf-5cd1-4668-b0f3-4d8ff41d0c32 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:37.610604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:37.611430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.611720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.611999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.625295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:37.626774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-7007d8c3-0269-47b5-bb21-90c031ef7ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:37.645418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:37.647418 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:37.649514 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:37.649514 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:37.649514 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:37.649514 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:37.651501 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 435/878] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:37.652656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:37.768685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954586-bac4-41cb-90c1-75edd3022c24 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:37.804709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f6a7-aef6-4bec-abd6-cef6547f5de3 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.805056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f6a7-aef6-4bec-abd6-cef6547f5de3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.805177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:37.805367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f6a7-aef6-4bec-abd6-cef6547f5de3 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.805862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.806156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.806436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.806987 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 436/879] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:37.807173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:37.807478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:37.808867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:37.812212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f107-5158-4f2a-acd7-1394f59f60db None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.812503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f107-5158-4f2a-acd7-1394f59f60db None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.812786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f107-5158-4f2a-acd7-1394f59f60db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.822135 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 444/880] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:37.830297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:37.830526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d093f107-5158-4f2a-acd7-1394f59f60db None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:37.831717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d093f107-5158-4f2a-acd7-1394f59f60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:37.895357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:37.925243 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 437/881] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:37.927026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4bec1-9114-4413-949f-081f6b62e7cd None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.927322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4bec1-9114-4413-949f-081f6b62e7cd None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.927603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4bec1-9114-4413-949f-081f6b62e7cd None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.928981 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 438/882] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:37.934135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:37.934425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:37.934707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:37.955340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:37.956522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:37.964905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521235fa-564e-4942-bc57-216721f4eb62 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:37.984699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.002517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.003329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.003612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.003883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.011513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.012962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.030410 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 439/883] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:38.030576 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:38.031491 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:38.032420 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 445/884] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:34:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:38.037398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.037545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.146558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfc7d-f567-4116-9fd2-cca69fe958a9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.152624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd64a4-2b0f-4f88-b629-66a19af66bbd None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.160504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.188111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.188803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.189087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.189387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.190218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:38.190526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.190709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.191376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.191738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.191942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.192128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.192666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.194048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.217200 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 440/885] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:38 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:38.217448 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 446/886] 10.222.0.45 () {56 vars in 1149 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:38.217562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.218536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.258668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.375163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29fb7-7844-4606-b490-8a4436feca43 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.377198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115bfe-36f4-45e8-abef-bf36077d7b4c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.424528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7469d-8ffa-41f8-99c3-fe36e8141473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.425829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7469d-8ffa-41f8-99c3-fe36e8141473 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.426459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7469d-8ffa-41f8-99c3-fe36e8141473 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.426995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7469d-8ffa-41f8-99c3-fe36e8141473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.429296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.430184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.430537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.430882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.432738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.434171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:38.448662 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:38.449788 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:38.450605 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 441/887] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:38.457827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.481698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.523176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7469d-8ffa-41f8-99c3-fe36e8141473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.524719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7469d-8ffa-41f8-99c3-fe36e8141473 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.550038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.563533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd72f-96f7-4431-98de-3a1a2fb97626 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.600462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.601048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.601369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.601649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.602354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:38.602662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.604413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034bf6-13f6-4fe1-bd1a-952d37e9ba7a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.614797 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 442/888] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:38.614797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23791-fcbc-4bca-a968-4f2cf37e48db None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.614797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23791-fcbc-4bca-a968-4f2cf37e48db None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.614797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23791-fcbc-4bca-a968-4f2cf37e48db None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.614797 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 443/889] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:38.618158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23791-fcbc-4bca-a968-4f2cf37e48db None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.642689 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 447/890] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:34:38.642689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.642689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.642689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.661782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:38.662995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:38.725223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23791-fcbc-4bca-a968-4f2cf37e48db None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.737833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.744335 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 448/891] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:38.745261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.773401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.774081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.774368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.774646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.775356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:38.775662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.777033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.782958 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 444/892] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:38.783613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.801014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:38.891915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c31e10-f88e-405b-980e-f4ea73b441cf None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.917306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e98ff-d932-4589-9162-f7c07d69344d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:38.931644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.932556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.932930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.933308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.946297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.947904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.965810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:38.967361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:38.967833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:38.967938 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:38.968754 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:38.969636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:38.969636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:38.969636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:38.969636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:38.970495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:38.971448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:38.973027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:38.973728 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 449/893] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:38.975555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:38.989948 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:38.991304 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:38.992114 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 445/894] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:38.999239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.046763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.105076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.107248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ef6de-f5ec-4bb3-8079-de3af71d1b6e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.139326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc90785-272a-4e37-941f-f7debc6eb183 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.146688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.147401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.147773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.148121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.148860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:39.149198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.150596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.167468 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 450/895] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:39.168618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.182351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.183317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.183604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.183885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.184654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:39.185741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.187986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.198332 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 446/896] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:39.205337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.285619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68927e-9450-4d1f-a298-686a5fbdb9c3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.298056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.325707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.327324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.327715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.328095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.337415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.339200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.345758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a91392-6f24-4efb-94e7-3f68514eddd9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:39.360253 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:39.361398 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:39.362293 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:39.367055 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 451/897] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:39.368346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.393270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.394891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.395417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.396021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.397073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:39.397823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.400201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.413024 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 447/898] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:39.414284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.417329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.485098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ea23f-38e7-4f4d-80f4-55817db46bab None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.528612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.529499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.529915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.530336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.531154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:39.531473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.533565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.550205 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 452/899] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:39.552010 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41982c-5809-46b1-9dfd-464dac7bbf45 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.557182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.589338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.603720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.605430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.605966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.606393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.608154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] RBAC: Adding query filter params (interface=public, service_id=1262b697062c477bb5b2bccf794b635d, region_id=RegionOne) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:39.608635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.610932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.622922 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 448/900] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/endpoints?service_id=1262b697062c477bb5b2bccf794b635d&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:39.623871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.686861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d24d-9161-4c19-b796-1839f281a5e1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.702896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.725743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.726491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.726782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.727064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.727900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] RBAC: Adding query filter params (role.id=6092b215612545ddaafb66fd46e2eb33, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=9ea2526f970f4d069dd6af31de04e340) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:39.728214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.730023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ebd39-2040-49a1-a795-7ef3a3e36171 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.736143 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 453/901] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/role_assignments?user.id=9ea2526f970f4d069dd6af31de04e340&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=6092b215612545ddaafb66fd46e2eb33 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:39.745047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b53fd-a043-4c7b-b5d5-8c573fffe51c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.785948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b78ff-8235-4424-83dc-3f3de14842fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.787043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b78ff-8235-4424-83dc-3f3de14842fe None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.787553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b78ff-8235-4424-83dc-3f3de14842fe None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.788043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b78ff-8235-4424-83dc-3f3de14842fe None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.788932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b78ff-8235-4424-83dc-3f3de14842fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.790575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b78ff-8235-4424-83dc-3f3de14842fe None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.797928 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 449/902] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:40.589643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54309e-a626-4110-92a6-0333925bac49 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.590133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54309e-a626-4110-92a6-0333925bac49 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.590133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54309e-a626-4110-92a6-0333925bac49 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.592501 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 454/903] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:40.598212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.598655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.598867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.616590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:40.617822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:40.693752 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 450/904] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:40.713264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54309e-a626-4110-92a6-0333925bac49 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.816238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:40.826455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54309e-a626-4110-92a6-0333925bac49 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.862694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.863484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.863931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.864327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.864997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.866431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:40.880280 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:40.881626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:40.882477 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:40.885376 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 455/905] 10.222.0.45 () {56 vars in 1132 bytes} [Mon May 23 12:34:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:40.888586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.952229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:41.000749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74aa28-73ab-4806-9e9d-eeabdd4176da None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:41.038091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:41.038767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.039051 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.039331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.040049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:41.040361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:41.041760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5c3df-bdc2-4b28-8439-aabf1ef1e5f9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.047485 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 451/906] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:41.052866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:41.159404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b8e0-3095-44a1-8987-34585f7301e0 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.159588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b8e0-3095-44a1-8987-34585f7301e0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.159879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b8e0-3095-44a1-8987-34585f7301e0 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.161532 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 452/907] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:41.164512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31b5a-1eca-474b-baf5-c9fb962a661d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:41.166636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.167871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.168366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.190391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:41.192251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:41.201467 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:41.202131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.202414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.202691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.203399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:41.203706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:41.205084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.213269 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 456/908] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:41.216594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:41.242665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:41.281165 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 453/909] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:41.299392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:41.360092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7aec50-7a72-4bcc-b767-75448bd954c1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:41.368294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:41.396085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:41.396917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.397335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.397736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.398665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] RBAC: Adding query filter params (interface=public, service_id=15daacd3394f4020bea8fb682746f539, region_id=RegionOne) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:41.399052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:41.400540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.411404 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 457/910] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:41 2022] GET /identity/v3/endpoints?service_id=15daacd3394f4020bea8fb682746f539&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:41.412699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:41.421235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24a67e-3662-454b-96a4-43d40a9ba877 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:41.460171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d826-1e5e-4b8d-9a44-b77cfdc0aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:41.461314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d826-1e5e-4b8d-9a44-b77cfdc0aa8f None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.461883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d826-1e5e-4b8d-9a44-b77cfdc0aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.462332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d826-1e5e-4b8d-9a44-b77cfdc0aa8f None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.463268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d826-1e5e-4b8d-9a44-b77cfdc0aa8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:41.464973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d826-1e5e-4b8d-9a44-b77cfdc0aa8f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.489218 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 454/911] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:41 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:41.523205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:41.543079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ac01-1c5a-4ed8-813c-a83b56c4d9a7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:41.589086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59135eb3-9057-4499-b5fb-f56ef840ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:41.590162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59135eb3-9057-4499-b5fb-f56ef840ad50 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.591102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59135eb3-9057-4499-b5fb-f56ef840ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.592061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59135eb3-9057-4499-b5fb-f56ef840ad50 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.592985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59135eb3-9057-4499-b5fb-f56ef840ad50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:41.594604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59135eb3-9057-4499-b5fb-f56ef840ad50 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.606298 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 458/912] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:41 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:42.024722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7bfcb-11ca-48b8-95e9-571d1453796e None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.025286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7bfcb-11ca-48b8-95e9-571d1453796e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.025365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7bfcb-11ca-48b8-95e9-571d1453796e None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.026812 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 455/913] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:42.032638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f597b-cab5-4e69-b486-aa709a9bc60d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.032933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f597b-cab5-4e69-b486-aa709a9bc60d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.033237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f597b-cab5-4e69-b486-aa709a9bc60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.053157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f74f597b-cab5-4e69-b486-aa709a9bc60d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:42.054368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f74f597b-cab5-4e69-b486-aa709a9bc60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:42.127718 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 459/914] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:42.151378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7bfcb-11ca-48b8-95e9-571d1453796e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.155827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32279-608e-4f77-86e4-4bf93b1fd398 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.156116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32279-608e-4f77-86e4-4bf93b1fd398 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.156394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32279-608e-4f77-86e4-4bf93b1fd398 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.157921 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 460/915] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:42.166734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.167020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.167301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.185926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:42.187335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:42.268377 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 461/916] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:42.278190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7bfcb-11ca-48b8-95e9-571d1453796e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.291993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.298150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.303734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.323076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.324264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.324747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.325333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.337528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:42.347163 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:42.348151 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:42.348968 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:42.351790 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 456/917] 10.222.0.45 () {56 vars in 1120 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:42.358553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.431634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600b98e-6e55-4c38-8026-119cb4c42a60 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.472965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.474652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.475104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.475573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.476834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.479432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:42.496684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:42.497943 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:34:42.498935 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:42.502315 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 462/918] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:42.503841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17643e1-c2ea-4a13-980b-8245d93e4cb5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.514446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.546250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.546887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.547173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.547790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.548182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:42.548486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.549889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.558374 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 457/919] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:42.564239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.602397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.617565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.661928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5abc5-9c6a-48a8-b0e4-d3a9eaf25be2 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.682701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26371d-2d91-49cb-80b2-77d6393fa4ae None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.709346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.710553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.711267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.711749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.713381 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:42.713872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.716981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.721047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.721951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.722344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.722722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.724411 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 463/920] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:42.734948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.735555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.737011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:42.758281 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:42.759205 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:42.760070 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:42.760070 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:42.760070 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:42.760070 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:42.764340 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 458/921] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:42.765983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.868785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6dc1-16ef-47d0-9592-1c38c7c311cd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.890821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.909541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4785-16d2-4b00-9d0a-7ed7a35cd569 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.913604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.914539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.915025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.915505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.916491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:42.917481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.920014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.922346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.928858 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 464/922] 10.222.0.45 () {56 vars in 1114 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:42.933611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.954947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.955939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.956451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.958000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.958752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:42.959203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.960981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.981232 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 459/923] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:42.985827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:43.054480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85617-df30-4079-bf92-a8541d8bd4c7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:43.089956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:43.090526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.090812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.091220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.091978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:43.093445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:43.101108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472224a-dd68-4bae-9576-e6c834bcd812 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:43.119842 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 465/924] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:43.157294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:43.158186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.158475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.158801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.167600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:43.169121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:43.188259 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:43.189321 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:43.190214 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 460/925] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:43.197241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:43.265968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:43.317888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419896e-c2da-45c2-9bc2-6dcf40d051e7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:43.358290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:43.359021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.359307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.359582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.360423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:43.360739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:43.362238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:43.381457 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 466/926] 10.222.0.45 () {56 vars in 1149 bytes} [Mon May 23 12:34:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:43.386921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:43.392667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:43.502806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4628293-b956-488a-bfe6-ad7e45b79849 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:43.539788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:43.540591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.540875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.541167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.552732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:43.554230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:43.572659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:43.573580 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:43.574434 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:43.574434 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:43.574434 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:43.574434 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:43.574434 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 461/927] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:43.579826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:43.691617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d425e3a-fa8a-4acc-989f-6f67499d41a7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:43.706938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:43.734663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:43.735338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.735622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.735901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.736627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:43.736938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:43.738361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a6ba-e728-4272-97cf-34a299e83f4c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:43.750754 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 467/928] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:43.757807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:43.819782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:43.832116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356767a-e2a1-4727-86dd-a5210a56ff76 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.832409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356767a-e2a1-4727-86dd-a5210a56ff76 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.832704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356767a-e2a1-4727-86dd-a5210a56ff76 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.835419 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 468/929] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:34:43.839428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.839716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.839997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.861208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:43.862878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:43.873115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f49ce-9136-4368-8b92-a5310c772d05 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:43.914011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:43.915117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:43.915602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:43.916060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:43.924475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:43.926613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:43.942469 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:43.943350 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:43.944211 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:43.951226 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 462/931] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:43.951437 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 469/931] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:43.952480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:43.973682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.079645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72122-387e-447e-92fd-24557e31ff9d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.081680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.096351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551be5-3dd3-4cb6-bfde-370e7f6eb3a7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.114262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.125797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.126463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.126749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.127040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.127810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:44.128125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.129709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94a5d7-fc6c-4594-9494-55239782bbd3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.136962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.137650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.138461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.138798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.139458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.140810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.143278 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 470/932] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:44.144542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4673-56e2-414b-ba0a-152b2b3f1653 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.144841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4673-56e2-414b-ba0a-152b2b3f1653 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.145125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4673-56e2-414b-ba0a-152b2b3f1653 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.146380 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 471/933] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:44.149300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac4673-56e2-414b-ba0a-152b2b3f1653 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-99731207-f2ad-4753-9017-b738d508cf78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:44.161200 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:44.162331 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:44.163210 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 463/934] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:44.163999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.163999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.165007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.184291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:44.185544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:44.262342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac4673-56e2-414b-ba0a-152b2b3f1653 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.263530 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 464/935] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:44.264370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.307089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.308106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.308238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.308521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/9ea2526f970f4d069dd6af31de04e340/roles/6092b215612545ddaafb66fd46e2eb33` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.311660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=9ea2526f970f4d069dd6af31de04e340, role_id=6092b215612545ddaafb66fd46e2eb33)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.312955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.327573 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 472/936] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:34:44 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/9ea2526f970f4d069dd6af31de04e340/roles/6092b215612545ddaafb66fd46e2eb33 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:44.328411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.362752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.441065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ab53-5530-44a5-9818-dad84ae9bdab None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.457418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.460028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c073-0e55-42e3-8a25-08e83cc24578 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.489742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.490852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.491363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.491836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.492852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:44.493482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.495199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.499289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.500125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.500408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.500685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.501394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.502869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.504554 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 465/937] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:44.513779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:44.517017 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:44.517975 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:44.518786 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 473/938] 10.222.0.45 () {56 vars in 1132 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:44.524322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.623549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.644066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4478-215e-49c2-a7e2-e56aefa29118 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.648938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e1a6-7e21-4f15-a8a9-773c3ecac68d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.683519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.684326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.684714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.685126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.686235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:44.686839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.688241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.694071 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 474/939] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:44.696115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.696946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.697408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.697838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.698665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:44.699098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.699196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.701296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.708333 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 466/940] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:44.717181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.793580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.815268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b4a8-5222-4836-8259-62216a843c16 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.836749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50762ab-dcaa-4ea1-b184-5bf60abeeeb6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.854494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.855223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.855510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.855789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.857233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:44.857751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.859360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.869409 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 475/941] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:44.871148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.876859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.877646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.877931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.878208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.878990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] RBAC: Adding query filter params (interface=public, service_id=b43a897065a147929635bf5741cbe417, region_id=RegionOne) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:44.879301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.880744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.886692 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 467/942] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/endpoints?service_id=b43a897065a147929635bf5741cbe417&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:44.892279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.893861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:45.012117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcf1d8-830e-4329-a58b-5b7314f4c0d3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:45.020594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eeeed-6a5d-4338-a69b-eb72237a03bc None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:45.022421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:45.060215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e653776-59f3-4e47-aeed-0a38a2b6de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:45.060989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e653776-59f3-4e47-aeed-0a38a2b6de54 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:45.061424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e653776-59f3-4e47-aeed-0a38a2b6de54 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:45.061777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e653776-59f3-4e47-aeed-0a38a2b6de54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:45.062819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e653776-59f3-4e47-aeed-0a38a2b6de54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:45.064440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e653776-59f3-4e47-aeed-0a38a2b6de54 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:45.065024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c059cf1-8d0e-4dbd-913a-bc191d1f8af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:45.066018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059cf1-8d0e-4dbd-913a-bc191d1f8af7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:45.066486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059cf1-8d0e-4dbd-913a-bc191d1f8af7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:45.067120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059cf1-8d0e-4dbd-913a-bc191d1f8af7 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:45.067992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059cf1-8d0e-4dbd-913a-bc191d1f8af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:45.070300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059cf1-8d0e-4dbd-913a-bc191d1f8af7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:45.084400 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 468/943] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:45.093290 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 476/944] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:45.556180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760980aa-0fec-4e6e-a297-00df35526a48 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:45.556702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760980aa-0fec-4e6e-a297-00df35526a48 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:45.556780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760980aa-0fec-4e6e-a297-00df35526a48 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:45.558500 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 469/945] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:45.564325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80647-295f-46df-a320-5f485787ef05 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:45.564621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80647-295f-46df-a320-5f485787ef05 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:45.564904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80647-295f-46df-a320-5f485787ef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:45.587814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-74e80647-295f-46df-a320-5f485787ef05 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:45.589454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-74e80647-295f-46df-a320-5f485787ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:45.661224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:45.673913 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 477/946] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:45.712844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760980aa-0fec-4e6e-a297-00df35526a48 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:45.864646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760980aa-0fec-4e6e-a297-00df35526a48 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:45.901294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:45.902015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:45.902308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:45.902590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:45.903304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:45.904987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:45.906397 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING keystone.server.flask.common [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 12:34:45.925045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.sql.core [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 12:34:45.925045 dv-cinder-master-3-smb devstack@keystone.service[90355]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 12:34:45.925045 dv-cinder-master-3-smb devstack@keystone.service[90355]: [parameters: {'id': '8b1fc870ce734fb0bd0edda293561428', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 12:34:45.925045 dv-cinder-master-3-smb devstack@keystone.service[90355]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90355) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b1fc870ce734fb0bd0edda293561428.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b1fc870ce734fb0bd0edda293561428. May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application conn.query(q) May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:34:45.943007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application result.read() May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 12:34:45.943895 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application next(self.gen) May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application yield resource May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application next(self.gen) May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self.session.rollback() May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self.force_reraise() May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise self.value May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application session.commit() May 23 12:34:45.944813 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._prepare_impl() May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self.session.flush() May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._flush(objects) May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application compat.raise_( May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application flush_context.execute() May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 12:34:45.945708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rec.execute(self) May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 12:34:45.946569 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application conn.query(q) May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application result.read() May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:34:45.947336 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [parameters: {'id': '8b1fc870ce734fb0bd0edda293561428', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:45.948184 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:45.948944 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b1fc870ce734fb0bd0edda293561428. May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:45.955724 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 470/947] 10.222.0.45 () {60 vars in 1140 bytes} [Mon May 23 12:34:45 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:45.956416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e80647-295f-46df-a320-5f485787ef05 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:46.064601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e80647-295f-46df-a320-5f485787ef05 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:46.100704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:46.101532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.101817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.102097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.113434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:46.115053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-dc1147c7-d8c7-46b1-add5-d810bac20f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:46.131036 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:46.133052 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:46.135148 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 478/948] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:46.139518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:46.167101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:46.252278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a134-0b61-4021-8f23-73cb3f1ef35a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:46.289529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:46.290439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.290877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.291325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.292247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:46.292704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:46.295095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054b00-9ef9-4588-ace7-59f54f89c444 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:46.321053 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 471/949] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:46.753855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3d82-8904-44fa-8774-a91baa457381 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.754140 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3d82-8904-44fa-8774-a91baa457381 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.754420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3d82-8904-44fa-8774-a91baa457381 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.756045 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 479/950] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:46.761314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.761778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.761860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.782368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:46.784281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:46.869170 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 472/951] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:46.887414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e3d82-8904-44fa-8774-a91baa457381 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:46.950553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:47.001243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e3d82-8904-44fa-8774-a91baa457381 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.037216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.037956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.038234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.038506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.051511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:47.060457 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:47.061614 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:47.062592 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 480/952] 10.222.0.45 () {56 vars in 1120 bytes} [Mon May 23 12:34:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:47.068364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.083522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:47.175510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22832eb0-d4cd-4d98-b717-c73ff3b69cba None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.211505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.212178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.212463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.212745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.213528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:47.213839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:47.215219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:47.224100 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 473/953] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:47.229894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.334721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1904e-275a-48d2-ab2d-fc0b806b499f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.357965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:47.376532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.377413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.377699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.377989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.391807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:47.393365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-a41a4870-6464-4905-8c7e-1ccab53f9448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:47.413080 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:47.414073 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:47.414944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:47.414944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:47.414944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:47.414944 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:47.414944 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 481/954] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:47.420990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.505903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:47.536822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cfdde-f8dc-4dc1-8421-6998326ad97b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.573165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5891d7-e417-4614-bc95-5837632b5a79 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.573165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5891d7-e417-4614-bc95-5837632b5a79 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.573165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5891d7-e417-4614-bc95-5837632b5a79 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.573165 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 482/955] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:47.573165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.573676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.573676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.576034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.576711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.576999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.577453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.578193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:47.578546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:47.579924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e19204-221e-4273-8e4c-4544a3c6d246 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:47.590585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:47.592256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:47.593269 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 474/956] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:47.597179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e23e6-2bd6-49f0-88e5-01273267742a None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.597179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e23e6-2bd6-49f0-88e5-01273267742a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.597179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e23e6-2bd6-49f0-88e5-01273267742a None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.597179 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 475/957] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:47.601601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.601895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.602178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.620580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:47.621805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:47.677547 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 483/958] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:47.679202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.698892 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 476/959] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:47.701743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.776739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:47.794489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:47.799227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19422-bd81-4549-bbdb-41df8ae5cd04 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.818215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380f7e-8223-4693-b1dc-2d690f1aeb99 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.836707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.837637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.837917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.838192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.846357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:47.847735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:47.855912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.857635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.858107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.858597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.859483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:47.861105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:47.864222 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:47.865256 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:34:47.866220 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:47.869507 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 484/960] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:47.870759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:47.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:47.879424 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:47.880258 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:47.881686 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 477/961] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:47.882613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.986971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec4c64-9ac0-4dd2-9f71-98ad4737c7d8 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.992107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf25e-9c0b-485c-ba7a-a5803614ee1b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.020461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.027662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.029020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.029652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.030004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] PATH_INFO: `/v3/services/compute` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.030104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.030658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.030756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.030968 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.031245 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.032035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.032130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:48.032385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.033833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:48.045999 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:48.047282 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:48.048277 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:48.050550 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 485/962] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:48.051542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.058003 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 478/963] 10.222.0.45 () {56 vars in 1149 bytes} [Mon May 23 12:34:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:48.059112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.080565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.162032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff9d6-45fe-4f56-b6d5-670d5a012efb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.166296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924732c-c7a1-4d3a-a6c8-3b04e09571c1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.201235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.201429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.201903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.202008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.202183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.202282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.202468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.202585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.203164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:48.203261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] RBAC: Adding query filter params (name=compute) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:48.203468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.203578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.204841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.204941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.214770 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 479/964] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:48.214930 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 486/965] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:48.215013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.215461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.269912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.311294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.328010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0762-68ad-4aa5-8c2d-a30f3006a7b0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.332313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975313-0f4a-4632-aa79-feadf8e58734 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.370787 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.371462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.371751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.372033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.372771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.372981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] RBAC: Adding query filter params (type=compute) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:48.373320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.373482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.373735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.374016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.374712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.379751 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 487/966] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:48.386737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.469172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.471012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.533884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.544893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7c3d6-d6cc-4b24-b497-33fc63e3741c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.594163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.594834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.595114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.595387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.596088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:48.596394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.597174 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 480/967] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:34:48.597864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.604660 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 488/968] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:48.605493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.611134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.629903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.714140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acdcd5-5089-4beb-aabf-6b5d77c8e09a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.723873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef24dd-6797-4024-a6b2-a891d84fa5ec None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.752534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.753780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.754362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.754813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.763247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.763917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.764254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.764540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.765369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.766967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.768546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.770505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.793258 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 489/969] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:34:48.796496 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:48.797802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:48.798654 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:34:48.798654 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:34:48.798654 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:34:48.798654 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:48.798654 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 481/970] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:48.805061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:48.888784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:48.932153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b6801-b0c9-49b1-80db-9468b6b9f564 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:48.971575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:48.972261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:48.972544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:48.972947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:48.973831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:48.983807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:48.985737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d480aa4-e4c5-42b2-8735-135bfab72a4e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:48.999724 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 490/971] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:49.005298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:49.008157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:49.013664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01097d-8ace-4591-9bce-72f93ce01402 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.013991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01097d-8ace-4591-9bce-72f93ce01402 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.014272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01097d-8ace-4591-9bce-72f93ce01402 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.016469 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 491/972] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:49.022753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.023209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.023491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.047374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:49.049033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:49.124146 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 492/973] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:49.146449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d03e66-5e36-4c96-b545-85427a2ca5c0 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:49.150466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:49.198118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:49.199962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.200993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.201512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.211746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:49.213707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:49.215825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:34:49.234120 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:49.235021 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:34:49.235878 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:49.240279 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 482/974] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:49.241233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:49.280978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fccd43-0915-4d21-9271-80fe7a55ec4a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:49.307154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:49.335938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:49.336871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.337405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.338417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.339652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:49.342754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:49.344337 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING keystone.server.flask.common [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 12:34:49.354765 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e027a8b-dc24-4319-b674-2b8eefcb6023 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:49.362809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.sql.core [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 12:34:49.362809 dv-cinder-master-3-smb devstack@keystone.service[90356]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 12:34:49.362809 dv-cinder-master-3-smb devstack@keystone.service[90356]: [parameters: {'user_id': 'fb9f5f4da2b749cbbaa9c35872462b85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 12:34:49.362809 dv-cinder-master-3-smb devstack@keystone.service[90356]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90356) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application conn.query(q) May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result.read() May 23 12:34:49.374225 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:34:49.375087 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application next(self.gen) May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application yield resource May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application next(self.gen) May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.session.rollback() May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.force_reraise() May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise self.value May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application session.commit() May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 12:34:49.376039 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._prepare_impl() May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.session.flush() May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._flush(objects) May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application compat.raise_( May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application flush_context.execute() May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rec.execute(self) May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 12:34:49.376907 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:34:49.378863 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application conn.query(q) May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application result.read() May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:34:49.379711 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fb9f5f4da2b749cbbaa9c35872462b85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:49.380622 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 12:34:49.382406 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:49.384815 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 493/975] 10.222.0.45 () {60 vars in 1131 bytes} [Mon May 23 12:34:49 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:49.386902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:49.403147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:49.404748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.405259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.405937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.407443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:49.407913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:49.410091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:49.429338 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 483/976] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:49.438243 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:49.514105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ae34-2e90-4721-a841-a89873b43b7b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:49.536867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:49.555366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99dc0d-fbdf-4fcc-948f-f8637dff0ee8 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:49.560195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:49.561346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.561783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.562211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.571904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:49.574282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:49.583259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:34:49.593301 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:49.594329 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:34:49.595380 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:49.598029 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 494/977] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:34:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:49.600491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:49.601385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.601838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.602296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.603426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:49.604850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] RBAC: Adding query filter params (role.id=6092b215612545ddaafb66fd46e2eb33, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=9ea2526f970f4d069dd6af31de04e340) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:49.605180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:49.607200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e47db7-0631-4b3a-8970-e17a4bb70c6a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:49.621189 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 484/978] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:34:49 2022] GET /identity/v3/role_assignments?user.id=9ea2526f970f4d069dd6af31de04e340&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=6092b215612545ddaafb66fd46e2eb33 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:49.731978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09e24-4182-4cf3-a5a7-4584df33d330 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:49.771838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:49.772437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:49.772717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:49.772988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:49.773838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] RBAC: Adding query filter params (name=cinder) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:49.774144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:49.775599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bddcd5-97e0-4b5d-89e9-e26a7066f8af None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:49.817997 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 495/979] 10.222.0.45 () {56 vars in 1101 bytes} [Mon May 23 12:34:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:50.691516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500de5a-39fa-4cdf-94af-f32b80f51891 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:50.692037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500de5a-39fa-4cdf-94af-f32b80f51891 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:50.692037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500de5a-39fa-4cdf-94af-f32b80f51891 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:50.693432 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 485/980] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:50.698662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7be9-99e2-41b3-af60-b693803fc91a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:50.699060 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7be9-99e2-41b3-af60-b693803fc91a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:50.699228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7be9-99e2-41b3-af60-b693803fc91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:50.717857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-83bd7be9-99e2-41b3-af60-b693803fc91a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:50.719399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-83bd7be9-99e2-41b3-af60-b693803fc91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:50.750150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:50.793102 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 496/981] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:50.815905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500de5a-39fa-4cdf-94af-f32b80f51891 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:50.925639 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500de5a-39fa-4cdf-94af-f32b80f51891 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:50.963988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ce64-5aa4-4f61-a9cd-fe96892423f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:50.964672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ce64-5aa4-4f61-a9cd-fe96892423f5 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:50.964961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ce64-5aa4-4f61-a9cd-fe96892423f5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:50.965269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ce64-5aa4-4f61-a9cd-fe96892423f5 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:50.966080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01ce64-5aa4-4f61-a9cd-fe96892423f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:50.967458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01ce64-5aa4-4f61-a9cd-fe96892423f5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:50.982670 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 486/982] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:50 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:51.131830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54050-b061-4cfe-8303-29db8d56a8fa None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.132159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54050-b061-4cfe-8303-29db8d56a8fa None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.132403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54050-b061-4cfe-8303-29db8d56a8fa None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.133982 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 497/983] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:51.141318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.141840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.142264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.160482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:51.161704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:51.211438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:51.246197 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 487/984] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:51.269803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd54050-b061-4cfe-8303-29db8d56a8fa None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:51.383592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd54050-b061-4cfe-8303-29db8d56a8fa None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:51.420103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:51.420971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.421288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.421568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.422228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:51.423622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:51.436106 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:51.437410 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:51.438283 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:51.441209 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 498/985] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:51.443652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:51.551763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff9c12-98e9-4115-8a22-7b4ac7be017f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:51.587939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:51.588615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.588901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.589207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.590035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:51.590348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:51.592307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:51.599635 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 488/986] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:51.603291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:51.635857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:51.710409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4639f5b-b334-40b4-9413-8b0069f2f028 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:51.748829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:51.749544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.749822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.750098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.750801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:51.751108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:51.752493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6a218-b2fc-4b49-9499-1f749c3e292f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:51.762556 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 499/987] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:51.764920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:51.802689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:51.874278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc8bf-11b9-4172-91a3-3b214c6bf8f1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:51.909399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:51.910021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274244-e5c8-4a04-9d76-4f9ccd6c94a1 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.910142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.910314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274244-e5c8-4a04-9d76-4f9ccd6c94a1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.910409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.910590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10274244-e5c8-4a04-9d76-4f9ccd6c94a1 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.910686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.911427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] RBAC: Adding query filter params (interface=admin, service_id=b43a897065a147929635bf5741cbe417, region_id=RegionOne) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:51.911817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:51.913227 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 500/988] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:51.913350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:51.919622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:51.919905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:51.920344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:51.921459 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 489/989] 10.222.0.45 () {56 vars in 1249 bytes} [Mon May 23 12:34:51 2022] GET /identity/v3/endpoints?service_id=b43a897065a147929635bf5741cbe417&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:51.924781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:51.939463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:51.941305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:52.015488 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 501/990] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:52.028095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:52.032201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce0f7c-8077-4012-8b02-7e3561b49a18 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:52.038231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:52.064313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:52.071457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:52.072188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:52.072409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:52.072689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:52.073405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:52.074823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:52.089721 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 490/991] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:51 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:52.150567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00bde-239c-484b-a02f-66b4221c5a41 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:52.193846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:52.194654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:52.194964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:52.195205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] PATH_INFO: `/v3/services/image` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:52.195862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:52.197285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:52.210676 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:52.211741 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:34:52.212561 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:52.217583 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 502/992] 10.222.0.45 () {56 vars in 1105 bytes} [Mon May 23 12:34:52 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:52.219286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:52.340415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7e8c-6499-45de-ba69-266cbf21f425 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:52.377518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:52.378184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:52.378465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:52.378740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:52.379447 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] RBAC: Adding query filter params (name=image) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:52.379752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:52.381101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6eb1a-ceff-46c2-a06b-581cc4cfd480 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:52.392718 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 491/993] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:52.393959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:52.487664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:52.500675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc829-d133-4f62-a095-eef995cf5b0d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:52.535310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:52.535968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:52.536246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:52.536518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:52.537236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] RBAC: Adding query filter params (type=image) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:52.537543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:52.538904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71998ed4-7e11-457a-8d4b-c0fdf1c4bd9e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:52.543563 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 503/994] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:53.320566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae89a-4f67-43d6-b893-043e485cd4fd None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:53.321086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae89a-4f67-43d6-b893-043e485cd4fd None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:53.321190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae89a-4f67-43d6-b893-043e485cd4fd None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:53.322550 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 492/995] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:53.328347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:53.329186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:53.329688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:53.349039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:53.350285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:53.419951 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 504/996] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:53.442719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae89a-4f67-43d6-b893-043e485cd4fd None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:53.472738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:53.549690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae89a-4f67-43d6-b893-043e485cd4fd None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:53.584534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:53.585277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:53.585563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:53.585838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] PATH_INFO: `/v3/services/compute` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:53.586482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:53.587961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:53.600494 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:53.601480 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:34:53.602293 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 493/997] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:53.608511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:53.698748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:53.720625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47121013-20b6-4d4e-9bd6-d68f2797cd91 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:53.757531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:53.758192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:53.758470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:53.758743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:53.759441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:53.759746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:53.761114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:53.771292 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 505/998] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:53.772720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:53.866718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:53.877290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee038f92-ec36-4267-896a-ab8286e5781c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:53.911890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:53.912557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:53.912842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:53.913121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:53.913927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] RBAC: Adding query filter params (type=compute) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:53.914239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:53.915609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:53.925457 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 494/999] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:53.926727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:54.030731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01bdd9-af07-4f1f-92e0-c4d5634c6fb3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:54.065093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:54.065793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.066074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.066347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.067125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] RBAC: Adding query filter params (interface=public, service_id=9e648632245541c586d218f6a1eda62c, region_id=RegionOne) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:54.067435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:54.068809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7827b4-2784-417e-be99-7c3cef850cc3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:54.079128 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 506/1000] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:53 2022] GET /identity/v3/endpoints?service_id=9e648632245541c586d218f6a1eda62c&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:54.080102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:54.189585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a08ca-a803-447c-86d9-32ff7480d4df None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:54.223428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4eb34-11e5-4cef-864e-bc6ffecb75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:54.224099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4eb34-11e5-4cef-864e-bc6ffecb75db None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.224385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4eb34-11e5-4cef-864e-bc6ffecb75db None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.224661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4eb34-11e5-4cef-864e-bc6ffecb75db None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.225366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4eb34-11e5-4cef-864e-bc6ffecb75db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:54.226742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4eb34-11e5-4cef-864e-bc6ffecb75db None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:54.241416 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 495/1001] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:54 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:54.336114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5e84-dd8b-49c1-8f90-34e4cc87abf6 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.336626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5e84-dd8b-49c1-8f90-34e4cc87abf6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.336704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5e84-dd8b-49c1-8f90-34e4cc87abf6 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.338113 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 507/1002] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:54.344299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.344800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.344877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.363816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:54.365069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:54.382405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:54.445632 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 496/1003] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:54.468555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe5e84-dd8b-49c1-8f90-34e4cc87abf6 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:54.483227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:54.577753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe5e84-dd8b-49c1-8f90-34e4cc87abf6 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:54.613412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:54.614210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.614493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.614767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.615421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:54.616856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:54.629796 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:54.630759 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:54.631630 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 508/1004] 10.222.0.45 () {56 vars in 1126 bytes} [Mon May 23 12:34:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:54.638690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:54.746399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc27c3-2b26-4200-b3b3-9e0650b84e89 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:54.781821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:54.782491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.782776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.783054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.783762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:54.784072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:54.785482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9eaa2-7e43-41a5-8adf-8c89f15c8ea9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:54.795625 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 497/1005] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:54.797194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:54.877991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:54.890514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0196-b239-4fce-a6e1-940ddb1df61f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.891102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0196-b239-4fce-a6e1-940ddb1df61f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.891396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0196-b239-4fce-a6e1-940ddb1df61f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.892929 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 498/1006] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:54.897761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.898049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.898323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.911088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2d52-3af1-4553-a480-15ca1ac2d707 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:54.915455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:54.916648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:54.927456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:54.948841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:54.949798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:54.950743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:54.951176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:54.952189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:54.952658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:54.954132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:54.959968 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 509/1007] 10.222.0.45 () {56 vars in 1122 bytes} [Mon May 23 12:34:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:54.966689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:54.994164 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 499/1008] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:55.017842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:55.083398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f1a3-7ba0-43bb-993e-051f8a7527dc None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:55.124155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f1a8b-8564-4c5b-bb64-8f914b492e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:55.125253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f1a8b-8564-4c5b-bb64-8f914b492e89 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:55.125750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f1a8b-8564-4c5b-bb64-8f914b492e89 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:55.126353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f1a8b-8564-4c5b-bb64-8f914b492e89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:55.127418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f1a8b-8564-4c5b-bb64-8f914b492e89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:55.129247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f1a8b-8564-4c5b-bb64-8f914b492e89 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:55.132340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da0279-c66e-445f-be39-f9b0620ee235 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:55.140783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:55.155745 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 510/1009] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:55.176460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16c01-3559-42a4-bd3f-980980925ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:55.177167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16c01-3559-42a4-bd3f-980980925ae4 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:55.177444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16c01-3559-42a4-bd3f-980980925ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:55.177724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16c01-3559-42a4-bd3f-980980925ae4 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:55.178503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d16c01-3559-42a4-bd3f-980980925ae4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:55.179904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d16c01-3559-42a4-bd3f-980980925ae4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:55.195771 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 500/1010] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:55 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:55.196144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:56.482476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a4c5c-f9cc-460c-ba34-18377d525a36 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:56.482997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a4c5c-f9cc-460c-ba34-18377d525a36 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:56.482997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a4c5c-f9cc-460c-ba34-18377d525a36 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:56.484565 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 511/1011] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:56.489594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:56.490001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:56.490165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:56.506959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:56.508149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:56.583542 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 501/1012] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:56 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:56.607555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a4c5c-f9cc-460c-ba34-18377d525a36 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:56.712897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a4c5c-f9cc-460c-ba34-18377d525a36 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:56.749314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:56.750120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:56.750403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:56.750682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:56.751329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:56.752709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:56.764661 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:56.765890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:34:56.766753 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:56.769923 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 512/1013] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:34:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:56.772070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:56.874773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452409b4-ca1c-47a1-8115-623b5a32e770 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:56.901876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:56.912246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:56.913003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:56.913403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:56.913751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:56.914531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:56.914914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:56.916375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:56.926623 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 502/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:56.928159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:56.992224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.035136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ba77a-355a-4a1f-8d9b-cdcff83629b4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:57.072349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:57.073639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.074229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.074843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.076796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] RBAC: Adding query filter params (type=compute) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:57.077477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:57.080220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c30f3-1a47-46f5-bbf8-cf4a5acce80e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:57.091948 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 513/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Mon May 23 12:34:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:57.093553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:57.197494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d78cf-2c0b-4031-9ab7-6607ae54a0b7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:57.234398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca3b4f-1b59-4051-a7d9-a66f783cadf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:57.235173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3b4f-1b59-4051-a7d9-a66f783cadf9 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.235526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3b4f-1b59-4051-a7d9-a66f783cadf9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.235873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3b4f-1b59-4051-a7d9-a66f783cadf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.236715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca3b4f-1b59-4051-a7d9-a66f783cadf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:57.238254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca3b4f-1b59-4051-a7d9-a66f783cadf9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:57.269188 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 503/1016] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:34:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:57.425112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944089a-71a0-4c52-ad6f-7e6a32795bf7 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.425502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944089a-71a0-4c52-ad6f-7e6a32795bf7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.425712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944089a-71a0-4c52-ad6f-7e6a32795bf7 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.427331 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 514/1017] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:57.432911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.433241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.433527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.451925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:57.453050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:57.484216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f38d4d-fd19-4cac-a50b-b38f39a7501d None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.484772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f38d4d-fd19-4cac-a50b-b38f39a7501d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.484772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f38d4d-fd19-4cac-a50b-b38f39a7501d None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.486151 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 515/1018] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:57.491191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.491476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.491752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.507902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.511728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:57.514224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:57.548198 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 504/1019] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:57.572449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:57.597171 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 516/1020] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:34:57.621363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:57.681737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798a15-aceb-4e57-92d3-8b80c333ecd2 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:57.683331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.722112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:57.722913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.723192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.723467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.724635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:57.726088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:57.728639 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 505/1021] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:57.732281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6403-7d9c-4843-addf-cdd88037b976 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:57.735741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:57.769510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:57.770301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.770612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.770862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] PATH_INFO: `/v3/services/image` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.771514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:57.773689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:57.781712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:57.785372 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:57.786359 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:34:57.787221 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:57.791620 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 517/1022] 10.222.0.45 () {56 vars in 1105 bytes} [Mon May 23 12:34:57 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:34:57.792520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:57.848412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f713c2-6e2b-49e6-b6cb-f32811fc8e3f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:57.885534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:57.886208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.886492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.886772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.887590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:57.889028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:57.902856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36107b2-e46b-4a24-a782-2d8b7c6bf396 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:57.918006 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 506/1023] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:34:57 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:57.927435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.946485 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:57.947307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:57.947659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:57.948008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:57.948805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] RBAC: Adding query filter params (name=image) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:57.949254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:57.951614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:57.957946 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 518/1024] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:57.963808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:58.068925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:58.081288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb7453-d031-42e1-bf52-f283b647b91c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:58.122590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:58.123678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:58.123963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:58.124254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:58.124972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:58.125687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:58.126708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:58.132149 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 507/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:34:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:58.140912 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:58.246657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5041f-f207-4101-8913-77a497d43a15 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:58.286616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:58.288007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:58.288674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:58.289380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] PATH_INFO: `/v3/endpoints` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:58.290903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] RBAC: Adding query filter params (interface=public, service_id=3f6e815d0acc4920bc4ca8795c3bbce6, region_id=RegionOne) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:58.291665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:58.294921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7103c-1478-463c-8540-fdf5484e943b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:58.304186 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 519/1026] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:34:58 2022] GET /identity/v3/endpoints?service_id=3f6e815d0acc4920bc4ca8795c3bbce6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:58.310350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:58.424786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4ac98-1280-471d-a925-8f3abd56e7c9 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:58.459943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22be1-39ae-461d-a52c-459bccfffb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:58.460617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22be1-39ae-461d-a52c-459bccfffb71 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:58.460997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22be1-39ae-461d-a52c-459bccfffb71 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:58.461346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22be1-39ae-461d-a52c-459bccfffb71 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:58.462028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22be1-39ae-461d-a52c-459bccfffb71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:58.463394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22be1-39ae-461d-a52c-459bccfffb71 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:58.477180 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 508/1027] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:34:58 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:59.653832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab15e4-41bd-4aa5-aad5-130317dbdebb None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:59.654454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab15e4-41bd-4aa5-aad5-130317dbdebb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:59.654454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab15e4-41bd-4aa5-aad5-130317dbdebb None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:59.655797 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 520/1028] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:59.661083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:59.661507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:59.661704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:59.679863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:59.681071 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:59.695861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:59.751700 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 509/1029] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:34:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:34:59.775518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab15e4-41bd-4aa5-aad5-130317dbdebb None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:59.827348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:59.881494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab15e4-41bd-4aa5-aad5-130317dbdebb None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:59.915098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:59.915835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:59.916118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:59.916394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:59.927756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:34:59.936587 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:34:59.937768 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:34:59.938585 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:34:59.941515 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 521/1030] 10.222.0.45 () {56 vars in 1120 bytes} [Mon May 23 12:34:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:34:59.943903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.051196 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad9ba-7e9f-413a-b993-de7e55eb1231 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.086122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.086800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.087084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.087361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.088107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:00.088415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.089822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc82486-77f4-480f-a5a0-6e408017e2b0 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.099020 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 510/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:34:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:00.104827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.206344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd2649-6332-4432-92d1-5e7cec1fcb5c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.216793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:00.220656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafa078-872a-4cbd-96ba-3d60cd6b13b2 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.220953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafa078-872a-4cbd-96ba-3d60cd6b13b2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.221264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafa078-872a-4cbd-96ba-3d60cd6b13b2 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.222919 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 511/1032] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:00.227879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.228169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.228700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.245695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:00.246917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:00.247766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.248562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.248967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.249271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.254743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:00.261650 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.263308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:00.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:00.283962 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:00.284834 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:00.284834 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:00.284834 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:00.284834 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:00.284834 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 522/1033] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:00.289981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.320775 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 512/1034] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:35:00.346465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.400485 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47602b-fabc-4bf2-b17c-84e2fcc2a18b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.438117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.438779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.439062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.439343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.440061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:00.440374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.441784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.458552 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 523/1035] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:00.458723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77d21-40e9-4a0c-bbdd-234de0024b9d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.460162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.486318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:00.494855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.495726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.496012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.496353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.497972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.499465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.501259 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 513/1036] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:00.507412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.521091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:00.583371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e0ee9-e1f1-415c-8010-b1995db796b6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.618573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc71a6-e576-4fc6-b811-a7d2b0417055 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.620459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.621477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.621636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.621869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.629696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.631301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:35:00.646500 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:00.647684 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 524/1037] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:00.654720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.665647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d00e0c-0149-49f4-8548-526d02007de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.666332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d00e0c-0149-49f4-8548-526d02007de8 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.666620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d00e0c-0149-49f4-8548-526d02007de8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.666898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d00e0c-0149-49f4-8548-526d02007de8 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.667618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d00e0c-0149-49f4-8548-526d02007de8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.669359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d00e0c-0149-49f4-8548-526d02007de8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.690663 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 514/1038] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:35:00 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:35:00.690663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa376-710b-4ac9-a2dd-16adee8ecd20 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.690663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa376-710b-4ac9-a2dd-16adee8ecd20 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.690663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa376-710b-4ac9-a2dd-16adee8ecd20 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.690663 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 515/1039] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:00.703822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.704174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.704391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.729572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:00.730850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:00.752276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:00.775628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc3bb-07e7-408c-a5b8-dbe68aa2ea72 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.803696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:00.812841 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 516/1040] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:00.818212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.818900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.819183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.819462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:00.820303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:00.820615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:00.822106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:00.836402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.848932 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 525/1041] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:00.850167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:00.958202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d6d10-cc2c-4c84-848f-10ae9f504868 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.970755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eea1c-8d5a-48c2-ab31-657ec5804999 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:00.998204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:00.998917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:00.999202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:00.999476 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] PATH_INFO: `/v3/services/image` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.000132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.001639 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.008838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.009513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.009798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.010073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:01.014014 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:01.015114 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:35:01.016007 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:01.017032 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 517/1042] 10.222.0.45 () {56 vars in 1105 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:01.019224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.022001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.082999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.094939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.096862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.133270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab59c-51d0-4064-9c98-bf51de592f34 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.174034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.174811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.175099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.176001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.176195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] RBAC: Adding query filter params (name=image) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:01.176510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.177908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.183774 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 518/1043] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:01.189789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.212915 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 526/1044] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:01.214524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.257054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.306624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b810fcb-6223-45f9-8ae7-6091672a5347 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.325992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17f1f1-ded0-4d7d-a3ea-b31a709bb3d4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.345953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.358943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.359615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.359902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.360179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.360882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] RBAC: Adding query filter params (type=image) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:01.361217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.362581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.362701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.363428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.363754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.364032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.368836 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 519/1045] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:01.374902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.375247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.376709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:01.395317 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:01.396266 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:01.397179 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:01.397179 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:01.397179 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:01.397179 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:01.397179 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 527/1046] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:01.402043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.488031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0099b1-767c-4063-b4bc-6b9e6eeb815e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.500805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.512004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ffa34-0956-44fa-9581-3aae045200c9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.524172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.524831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.525118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.525419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.526157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.527526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.547902 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 520/1047] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:35:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:01.569372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.570056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.570341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.570620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.571359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:01.571673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.573101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.586846 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 528/1048] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:01.593011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.648370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.713704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1e47-f3f8-45e6-ac7f-e33b21466dd8 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.751799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.752597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.752882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.753247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.760148 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.761660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:35:01.776746 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:01.777720 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:01.778712 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 521/1049] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:01.783935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.889878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aebb4c-a8c7-47a5-9412-35938543f74f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:01.924016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:01.924682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.924965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.925293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.926082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:01.926394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:01.927846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d721cc-d020-4478-8788-df9b5ad5ba07 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:01.941001 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 529/1050] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:01.947195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:02.054660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178028c-b6b2-46f9-b54f-6ef52b5f4941 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:02.057772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:02.092594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:02.093275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:02.093563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:02.093841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:02.094667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] RBAC: Adding query filter params (role.id=6092b215612545ddaafb66fd46e2eb33, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=e8c5ebd15be54c6badb07f37d58bda07) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:02.094978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:02.096395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36293-45e1-4a27-a0d2-405470c22fba None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:02.109185 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 522/1051] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/role_assignments?user.id=e8c5ebd15be54c6badb07f37d58bda07&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=6092b215612545ddaafb66fd46e2eb33 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:03.162196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e9af-fa5c-4e3e-b636-ab8d22a9c07b None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.162749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e9af-fa5c-4e3e-b636-ab8d22a9c07b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.162749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e9af-fa5c-4e3e-b636-ab8d22a9c07b None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.164242 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 530/1052] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:03.169405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.169804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.169996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.188427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:03.190505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:03.266896 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 523/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:03.291331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00e9af-fa5c-4e3e-b636-ab8d22a9c07b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.301065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:03.411498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00e9af-fa5c-4e3e-b636-ab8d22a9c07b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.447473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.448177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.448456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.448729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.459386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:03.467532 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:03.468506 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:03.474594 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 531/1054] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:03.476933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.576083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:03.581328 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1df875-015b-4df4-80a6-c6cbdc82f8d0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.615646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.616317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.616603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.616881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.617655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:03.617965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:03.619330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:03.632961 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 524/1055] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:03.634695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.718505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:03.756794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58238d-d05d-460b-aa3f-52472f46b622 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.791034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac969a-6103-4f95-9043-01b0ddb3b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.791906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac969a-6103-4f95-9043-01b0ddb3b232 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.792188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac969a-6103-4f95-9043-01b0ddb3b232 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.792466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac969a-6103-4f95-9043-01b0ddb3b232 None admin] PATH_INFO: `/v3/users/66e1ec3bffe84bd0a07bbd2e332cd582` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.807316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac969a-6103-4f95-9043-01b0ddb3b232 None admin] RBAC: Authorizing `identity:get_user(user_id=66e1ec3bffe84bd0a07bbd2e332cd582)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:03.808786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac969a-6103-4f95-9043-01b0ddb3b232 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:03.815252 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 532/1056] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:03 2022] GET /identity/v3/users/66e1ec3bffe84bd0a07bbd2e332cd582 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:03.816803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.841544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85cf0-3642-4c3c-9880-1189162cc8f5 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.841915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85cf0-3642-4c3c-9880-1189162cc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.842123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85cf0-3642-4c3c-9880-1189162cc8f5 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.843642 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 533/1057] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:35:03.848643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.848933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.849249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.867022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:03.868236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:03.928356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139ea6-3641-4cf8-948c-ddfdc5251af1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.940264 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 534/1058] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:35:03.962910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.964505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.965305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.965762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.966051 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.997047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.023382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.042066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.043570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.071898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caae723-a091-4ac2-8fbc-33882526cb8e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.108037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.108695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.108979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.109293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.156137 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 525/1059] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:04.162141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.190028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.191512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.225971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.251527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.276672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fdb4a-4888-4ddf-9eef-7059baec3ceb None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.305197 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 535/1060] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:35:04.310689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.316982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.317881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.318167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.318449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.319647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] RBAC: Authorizing `identity:get_project(project_id=18e2e72a36ca4027b74e9d22664ce6d5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.321102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.328195 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 526/1061] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:04.328932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.424575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d297-acb5-4f48-9da3-b1612b2988c6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.431872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6260-310c-44ea-b323-346bd269811f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.458276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.459063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.459342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.459617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.460011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.468687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.469381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.469664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.469849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.469944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.470754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5, user.id=66e1ec3bffe84bd0a07bbd2e332cd582) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:04.471068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.471332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.472494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16bc3e-56a7-429c-8ce7-eb30830b5651 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.477995 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 527/1062] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/role_assignments?user.id=66e1ec3bffe84bd0a07bbd2e332cd582&scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:04.479483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd693c-e6bb-42ff-abcb-590318559d94 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.479767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd693c-e6bb-42ff-abcb-590318559d94 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.480041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd693c-e6bb-42ff-abcb-590318559d94 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.481824 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 528/1063] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:04.487861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.488148 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.488429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:04.490805 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:04.491693 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:04.492604 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:04.492604 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:04.492604 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:04.492604 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:04.492604 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 536/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:04.499915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.509767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:04.510379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.510944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:04.595966 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 529/1065] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:35:04.616667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ab87-541b-4181-a3bc-fab8b93a32a9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.620252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.657382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.658518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.659104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.659381 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.660120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:04.661081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.661844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.675300 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 537/1066] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:04.734336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c98f-073d-46a7-800c-4e3d6c8bbbd8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.763144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.777659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.778573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.778856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.779166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.791504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:04.800031 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:04.801026 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:04.807299 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 530/1067] 10.222.0.45 () {56 vars in 1120 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:04.810490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.886224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.926426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457a49d-e81f-40ac-b720-f10e06a517df None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.962395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.963067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.963349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.963625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.964373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:04.964689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.966179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.974940 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 538/1068] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:04.981874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.086692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4846-79b6-4b4e-9253-c890d000c992 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.120922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.122363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.122651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.122933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.133588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.135040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:05.152727 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:05.153876 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:05.154770 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:05.154770 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:05.154770 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:05.154770 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:05.157292 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 531/1069] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:05.159809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.260442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68264a-a839-405a-9478-7bfd2b400afe None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.287343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:05.295774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.296435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.296721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.297004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.297762 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:05.298073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.299456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.312352 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 539/1070] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:05.317838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.353033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:05.419873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d9b5-94c0-41e8-bb15-5f51b234d47e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.453601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.454385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.454674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.454949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.462376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.463824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:35:05.477709 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:05.479076 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:05.480248 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 532/1071] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:35:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:05.485003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.584189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c2ccb-0b9c-4a61-aeea-b599265d1087 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.619807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.620392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.620677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.620950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.622476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:05.622783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.624228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.641958 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 540/1072] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:35:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:05.647654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.748676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:05.755995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca242285-8c76-4c84-85bb-e2915f495519 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.789408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.790191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.790475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.790754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.801759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.803215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:05.820539 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:05.821460 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:05.822560 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:05.822560 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:05.822560 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:05.822560 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:05.822560 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 533/1073] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:05.827670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.875968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:05.928314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35a0b-d5f6-477b-b1c1-0b85ce957f77 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.962105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.962763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.963046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.963326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.964052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:05.964363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.966754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.978937 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 541/1074] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:05.985371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:06.087832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345111-7b5c-4e16-a6ad-b2b47bf08c56 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:06.122095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:06.122891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:06.123179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:06.123459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:06.130185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:06.131569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:35:06.145775 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:06.146701 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:06.147773 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 534/1075] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:06.153525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:06.253228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7306-872f-44d3-96d4-7681ec5c6a44 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:06.260197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:06.288476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:06.289285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:06.289425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:06.289735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:06.290490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:06.290801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:06.292245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d3eaf-74d7-4c6a-87f1-82e5288997ab None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:06.304630 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 542/1076] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:06.311169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:06.320097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:06.417407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f4be-f4db-48d6-87cc-bb64a451ad0e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:06.452836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6825307-7a8c-42a5-93aa-ca3b230e2e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:06.453741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825307-7a8c-42a5-93aa-ca3b230e2e1a None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:06.454021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825307-7a8c-42a5-93aa-ca3b230e2e1a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:06.454328 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825307-7a8c-42a5-93aa-ca3b230e2e1a None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/e8c5ebd15be54c6badb07f37d58bda07/roles/6092b215612545ddaafb66fd46e2eb33` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:06.456443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6825307-7a8c-42a5-93aa-ca3b230e2e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=e8c5ebd15be54c6badb07f37d58bda07, role_id=6092b215612545ddaafb66fd46e2eb33)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:06.457900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6825307-7a8c-42a5-93aa-ca3b230e2e1a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:06.470697 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 535/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:35:06 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/e8c5ebd15be54c6badb07f37d58bda07/roles/6092b215612545ddaafb66fd46e2eb33 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:06.719101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878f90-70ff-4664-899f-283162ed67bf None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:06.719391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878f90-70ff-4664-899f-283162ed67bf None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:06.719671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878f90-70ff-4664-899f-283162ed67bf None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:06.721064 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 543/1078] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:06.726381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:06.726749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:06.727094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:06.743885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:06.745062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:06.804099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:06.812955 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 536/1079] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:35:06.835733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878f90-70ff-4664-899f-283162ed67bf None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:06.938779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878f90-70ff-4664-899f-283162ed67bf None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:06.972828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:06.973573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:06.973888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:06.974233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:06.984933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:06.992555 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:06.993691 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:06.994890 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 544/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:07.000329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:07.099248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e87e8-51d5-4b1a-8e7b-e77995c5089a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:07.132901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:07.133602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:07.133890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:07.134171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:07.134920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:07.135228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:07.136614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:07.145444 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 537/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:07.151289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:07.188704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:07.261616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74e294-ec54-4f94-8c38-fe28bf896706 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:07.295788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:07.296652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:07.296932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:07.297237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] PATH_INFO: `/v3/users/66e1ec3bffe84bd0a07bbd2e332cd582` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:07.298422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] RBAC: Authorizing `identity:get_user(user_id=66e1ec3bffe84bd0a07bbd2e332cd582)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:07.299852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:07.301534 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 545/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:07 2022] GET /identity/v3/users/66e1ec3bffe84bd0a07bbd2e332cd582 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:07.307682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:07.374973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:07.422290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb94ba-02da-4ebb-b6bd-d0717304c534 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:07.457166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e8cc-cec8-485d-a351-28e3cf429f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:07.458029 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e8cc-cec8-485d-a351-28e3cf429f62 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:07.458316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e8cc-cec8-485d-a351-28e3cf429f62 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:07.458598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e8cc-cec8-485d-a351-28e3cf429f62 None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:07.459780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e8cc-cec8-485d-a351-28e3cf429f62 None admin] RBAC: Authorizing `identity:get_project(project_id=18e2e72a36ca4027b74e9d22664ce6d5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:07.461250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e8cc-cec8-485d-a351-28e3cf429f62 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:07.462956 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 538/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:07 2022] GET /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:07.469587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:07.563146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:07.569941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d52b3-ed4a-49d0-80da-4af0ec84274b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:07.606667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772c398-68b6-4d7d-9784-74e78f1a314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:07.607552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772c398-68b6-4d7d-9784-74e78f1a314d None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:07.607832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772c398-68b6-4d7d-9784-74e78f1a314d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:07.608109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772c398-68b6-4d7d-9784-74e78f1a314d None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5/users/66e1ec3bffe84bd0a07bbd2e332cd582/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:07.610087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772c398-68b6-4d7d-9784-74e78f1a314d None admin] RBAC: Authorizing `identity:create_grant(project_id=18e2e72a36ca4027b74e9d22664ce6d5, user_id=66e1ec3bffe84bd0a07bbd2e332cd582, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:07.611529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772c398-68b6-4d7d-9784-74e78f1a314d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:07.625408 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 546/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:35:07 2022] PUT /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5/users/66e1ec3bffe84bd0a07bbd2e332cd582/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:08.689426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd56ca-7811-486d-9a18-e03b5d242cd4 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:08.689928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd56ca-7811-486d-9a18-e03b5d242cd4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:08.689928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd56ca-7811-486d-9a18-e03b5d242cd4 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:08.691340 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 539/1085] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:08.696674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:08.697072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:08.697263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:08.714278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:08.716144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:08.783982 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 547/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:08.807675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd56ca-7811-486d-9a18-e03b5d242cd4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:08.909048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd56ca-7811-486d-9a18-e03b5d242cd4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:08.935078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:08.944170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:08.944918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:08.945230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:08.945512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:08.956039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:08.964178 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:08.965170 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:08.966091 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 540/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Mon May 23 12:35:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:08.971609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:09.053790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:09.071002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f15006-80b5-44cb-9143-f51f15d49876 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:09.105059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:09.105840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.106357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.106666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.107403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:09.107712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:09.109077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:09.116806 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 548/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:35:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:09.123199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:09.222495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a24a01-ec73-47aa-9ce5-9318c79b995b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:09.256290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:09.257070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.257375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.257653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.267857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:09.269325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:09.287354 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:09.288241 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:09.289117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:09.289117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:09.289117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:09.289117 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:09.289117 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 541/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:09.295043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:09.395332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4b23-e1a6-47b7-9ebf-e287e39d8b3d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:09.429800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:09.430460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.430745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.431022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.431736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:09.432048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:09.433467 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:09.446168 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 549/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:09.452349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:09.492760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:09.553892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6491c-facc-42e4-8a1f-5ac53ddb3089 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:09.587571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:09.588360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.588648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.588930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.597204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:09.599219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:35:09.613700 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:09.614827 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:35:09.616074 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:09.617468 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 542/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Mon May 23 12:35:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:09.620539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:09.629515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:09.725794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4007-25fc-4f7a-be2e-a19e375df3ec None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:09.760797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:09.761407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.761692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.762496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.763332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:09.763642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:09.765078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93adb1-e446-4469-9f1b-7089fb33155f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:09.782323 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 550/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Mon May 23 12:35:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:09.788026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:09.884844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:09.889464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eebdc-0705-4520-8aea-40fd37ce8eb6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:09.904368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49ddd-b4ae-495e-a1d7-4b321792a71b None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.904659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49ddd-b4ae-495e-a1d7-4b321792a71b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.904940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49ddd-b4ae-495e-a1d7-4b321792a71b None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.906602 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 551/1093] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:09.911796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.912128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.912408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.923488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:09.924135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:09.924421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:09.924704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:09.930270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:09.931450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:09.992592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:09.994539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:09.996121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.002044 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 552/1094] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:35:10.026510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.092654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.101300 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 543/1095] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:35:10.103526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.126941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9608-8d15-43be-8244-7fab8275eb24 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.160903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.161722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.162003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.162279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.173450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:10.181060 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:10.182189 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:10.183207 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 553/1096] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:10.188725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.201722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9b89-21bd-4123-9d57-26c932ac6bb1 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.235822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.236613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.236897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.237207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.245127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.248224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.249727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:10.267166 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:10.268068 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:10.269098 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:35:10.269098 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:10.269098 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:35:10.269098 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:10.269098 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 544/1097] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:10.273946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.292921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8b8a8-e5a4-4acf-9771-a1bbf6fbaef0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.324096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.329985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.329985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.329985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.329985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.330344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:10.330344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.330943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.339621 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 554/1098] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:10.346107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.376675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085c675-acf1-40a3-8794-de9a5abb16d7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.410187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.410845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.411127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.411402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.412116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:10.412422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.414106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.426177 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 545/1099] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:10.431602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.451514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01f1a-b635-4837-8e0d-3a5f5a47c0c6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.467712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.486241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.487111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.487391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.487675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] PATH_INFO: `/v3/users/66e1ec3bffe84bd0a07bbd2e332cd582` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.488878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] RBAC: Authorizing `identity:get_user(user_id=66e1ec3bffe84bd0a07bbd2e332cd582)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.490373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.492007 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 555/1100] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/users/66e1ec3bffe84bd0a07bbd2e332cd582 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:10.498110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.534299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e8183-35d2-455f-8e42-936d4f311882 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.545113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.568647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.569481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.569769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.570053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.577072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.578576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:35:10.593340 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:10.594405 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:10.595680 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 546/1101] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:35:10.600244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.606977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b79b-9eb2-4693-88ec-c26895ccf3c3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.643210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.643858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.644143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.644419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.697648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.704178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2d0e-8ac0-4272-a162-ae5d4ae795f3 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.714119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.716319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.741073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.741753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.742035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.742311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.743090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:10.743396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.744822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.756377 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 547/1102] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:10.762695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.791870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.816467 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 556/1103] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:35:10.822248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:10.862780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda712-8096-42fa-91f6-cc2c584f1a0a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.895844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.896497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.896781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.897061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.897917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] RBAC: Adding query filter params (role.id=6092b215612545ddaafb66fd46e2eb33, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=e8c5ebd15be54c6badb07f37d58bda07) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:10.898232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.899662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.903492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:10.906253 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 548/1104] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/role_assignments?user.id=e8c5ebd15be54c6badb07f37d58bda07&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=6092b215612545ddaafb66fd46e2eb33 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:35:10.927889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8470e1-1715-4558-b262-05d0801064f7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:10.965630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5ce31-ede2-4aaa-bf82-5de2033834fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:10.966568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ce31-ede2-4aaa-bf82-5de2033834fa None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:10.966849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ce31-ede2-4aaa-bf82-5de2033834fa None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:10.967126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ce31-ede2-4aaa-bf82-5de2033834fa None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:10.968451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ce31-ede2-4aaa-bf82-5de2033834fa None admin] RBAC: Authorizing `identity:get_project(project_id=18e2e72a36ca4027b74e9d22664ce6d5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:10.969953 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ce31-ede2-4aaa-bf82-5de2033834fa None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:10.971780 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 557/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:10.978441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:11.078049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:11.085244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f774fd-4e33-4c7e-8cee-8b901c1a62d2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:11.121989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:11.122822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:11.123286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:11.123737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:11.125059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5, user.id=66e1ec3bffe84bd0a07bbd2e332cd582) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:11.125424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:11.126867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc496e9-01da-4f98-a044-95ffd70546e3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:11.133649 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 549/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:10 2022] GET /identity/v3/role_assignments?user.id=66e1ec3bffe84bd0a07bbd2e332cd582&scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:13.380674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adc930-e94c-40da-a4b7-7f0d19260375 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:13.381194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adc930-e94c-40da-a4b7-7f0d19260375 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:13.381288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adc930-e94c-40da-a4b7-7f0d19260375 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:13.382611 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 558/1107] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:13.388562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:13.389001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:13.389130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:13.406272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:13.407472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:13.472690 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 550/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:13.497971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adc930-e94c-40da-a4b7-7f0d19260375 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:13.602349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adc930-e94c-40da-a4b7-7f0d19260375 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:13.637805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5d24-254c-425c-8786-c23dcdbf26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:13.638630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5d24-254c-425c-8786-c23dcdbf26b1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:13.638952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5d24-254c-425c-8786-c23dcdbf26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:13.639329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5d24-254c-425c-8786-c23dcdbf26b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:13.640575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5d24-254c-425c-8786-c23dcdbf26b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:13.642153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5d24-254c-425c-8786-c23dcdbf26b1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:13.643897 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 559/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:13.649662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:13.735972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:13.747732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d996d-330b-4740-87e8-792f5535ad80 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:13.780901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3599a8b-e889-48d1-a2f3-568e309e5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:13.781601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3599a8b-e889-48d1-a2f3-568e309e5477 None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:13.781886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3599a8b-e889-48d1-a2f3-568e309e5477 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:13.782163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3599a8b-e889-48d1-a2f3-568e309e5477 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:13.782861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3599a8b-e889-48d1-a2f3-568e309e5477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:13.784281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3599a8b-e889-48d1-a2f3-568e309e5477 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:13.804991 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 551/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:35:13 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:16.035413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5543663-f058-4570-9952-9becc5ccda05 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:16.035951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5543663-f058-4570-9952-9becc5ccda05 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:16.035951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5543663-f058-4570-9952-9becc5ccda05 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:16.037363 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 560/1111] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:16.042659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:16.043239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:16.043459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:16.060509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:16.061733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:16.127528 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 552/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:16.151088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5543663-f058-4570-9952-9becc5ccda05 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:16.173641 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:16.253723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5543663-f058-4570-9952-9becc5ccda05 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:16.287322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:16.288097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:16.288375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:16.288648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] PATH_INFO: `/v3/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:16.290124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] RBAC: Authorizing `identity:get_role(role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:16.291530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:16.293441 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 561/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:16 2022] GET /identity/v3/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:16.299324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:16.373996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:16.398484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb06b-0323-430a-9105-f586d8a987c6 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:16.431685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:16.432537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:16.432817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:16.433088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] PATH_INFO: `/v3/users/b01baa34ba36415a88aa2a044b714eae` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:16.446398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] RBAC: Authorizing `identity:get_user(user_id=b01baa34ba36415a88aa2a044b714eae)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:16.447830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:16.450228 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 553/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:16 2022] GET /identity/v3/users/b01baa34ba36415a88aa2a044b714eae => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:16.456180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:16.543725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:16.555758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5206f-0815-4e44-a5e9-4e9f1a50e1dd None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:16.590771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:16.591408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:16.591689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:16.591963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:16.657658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:16.659106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:16.743090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:16.756513 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 562/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:16.763263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:16.860213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a4b44-4773-4536-bddd-96fc05bdc39e None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:16.889643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:16.894665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2ff08-050a-47c5-bcd1-5b64ed2b4960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:16.895513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2ff08-050a-47c5-bcd1-5b64ed2b4960 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:16.895793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2ff08-050a-47c5-bcd1-5b64ed2b4960 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:16.896065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2ff08-050a-47c5-bcd1-5b64ed2b4960 None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:16.897262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2ff08-050a-47c5-bcd1-5b64ed2b4960 None admin] RBAC: Authorizing `identity:get_project(project_id=18e2e72a36ca4027b74e9d22664ce6d5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:16.898681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2ff08-050a-47c5-bcd1-5b64ed2b4960 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:16.900345 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 554/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:16 2022] GET /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:16.906475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:17.004073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dd27-1f0e-4bdc-9cf5-b78ed5e325e1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:17.037000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:17.037680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:17.037962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:17.038239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:17.039058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] RBAC: Adding query filter params (role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5, user.id=b01baa34ba36415a88aa2a044b714eae) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:17.039373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:17.040803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bece7-2635-4692-9bb7-077e85026fac None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:17.046983 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 563/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:16 2022] GET /identity/v3/role_assignments?user.id=b01baa34ba36415a88aa2a044b714eae&scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:19.207823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce229ad-dd0f-48f5-90b6-afb148978b49 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.208363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce229ad-dd0f-48f5-90b6-afb148978b49 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.208363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce229ad-dd0f-48f5-90b6-afb148978b49 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.209789 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 555/1118] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:19.215866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.216251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.216419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.233250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:19.234442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:19.280543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:19.300062 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 564/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:19.323424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce229ad-dd0f-48f5-90b6-afb148978b49 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:19.424057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce229ad-dd0f-48f5-90b6-afb148978b49 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:19.457723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:19.458621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.458854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.459134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] PATH_INFO: `/v3/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.460600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] RBAC: Authorizing `identity:get_role(role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:19.461990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:19.463371 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 556/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:19 2022] GET /identity/v3/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:19.469461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:19.566475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cd00e-9423-43a7-b6c2-a602dad14435 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:19.599809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:19.600667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.600950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.601259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] PATH_INFO: `/v3/users/b01baa34ba36415a88aa2a044b714eae` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.602435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=b01baa34ba36415a88aa2a044b714eae)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:19.604132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:19.606436 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 565/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:19 2022] GET /identity/v3/users/b01baa34ba36415a88aa2a044b714eae => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:19.612238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:19.677638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:19.710136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df873d6e-945f-4bb9-8e72-66433f4c29f2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:19.744233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbe5a-7a68-4d18-a894-86029c4b7b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:19.745078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbe5a-7a68-4d18-a894-86029c4b7b04 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.745388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbe5a-7a68-4d18-a894-86029c4b7b04 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.745665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbe5a-7a68-4d18-a894-86029c4b7b04 None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.747113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fbe5a-7a68-4d18-a894-86029c4b7b04 None admin] RBAC: Authorizing `identity:get_project(project_id=18e2e72a36ca4027b74e9d22664ce6d5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:19.748534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fbe5a-7a68-4d18-a894-86029c4b7b04 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:19.750253 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 557/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:19 2022] GET /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:19.756279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:19.805651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:19.860286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78e1d-2669-4e9f-95a6-2a09fb41bfc6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:19.910143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02980b-4d10-457f-9b50-5d6efe9ac2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:19.911016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02980b-4d10-457f-9b50-5d6efe9ac2e4 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.911293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02980b-4d10-457f-9b50-5d6efe9ac2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.911565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02980b-4d10-457f-9b50-5d6efe9ac2e4 None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5/users/b01baa34ba36415a88aa2a044b714eae/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.913736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02980b-4d10-457f-9b50-5d6efe9ac2e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e2e72a36ca4027b74e9d22664ce6d5, user_id=b01baa34ba36415a88aa2a044b714eae, role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:19.915165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02980b-4d10-457f-9b50-5d6efe9ac2e4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:19.930592 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 566/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:35:19 2022] PUT /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5/users/b01baa34ba36415a88aa2a044b714eae/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:22.118121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea23a3e-85c8-41d5-8adb-69b13e4ce2e1 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:22.118661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea23a3e-85c8-41d5-8adb-69b13e4ce2e1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:22.118774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea23a3e-85c8-41d5-8adb-69b13e4ce2e1 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:22.120065 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 558/1124] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:22.125354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:22.125800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:22.125920 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:22.143197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:22.144381 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:22.215948 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 567/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:22.244039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea23a3e-85c8-41d5-8adb-69b13e4ce2e1 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:22.344390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea23a3e-85c8-41d5-8adb-69b13e4ce2e1 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:22.379585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:22.380368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:22.380654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:22.380932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] PATH_INFO: `/v3/roles/1026505750ef4861a26c8da2c19c9fa9` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:22.382423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] RBAC: Authorizing `identity:get_role(role_id=1026505750ef4861a26c8da2c19c9fa9)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:22.383788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:22.385193 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 559/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:22 2022] GET /identity/v3/roles/1026505750ef4861a26c8da2c19c9fa9 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:22.391192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:22.432188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:22.491428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d7ccb-b677-4415-8a6d-e2f2b63386e7 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:22.524869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:22.525756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:22.526038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:22.526314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] PATH_INFO: `/v3/users/b01baa34ba36415a88aa2a044b714eae` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:22.528212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] RBAC: Authorizing `identity:get_user(user_id=b01baa34ba36415a88aa2a044b714eae)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:22.529688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:22.531320 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 568/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:22 2022] GET /identity/v3/users/b01baa34ba36415a88aa2a044b714eae => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:22.537065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:22.540883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:22.634691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560b868-8110-4936-9596-a51bbf9b8e69 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:22.669350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:22.669993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:22.670281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:22.670562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:22.736726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:22.738229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:22.740792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:22.834341 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 560/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:22.840901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:22.937533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd01fd1-e34a-47c2-961f-422d2fb8e0ad None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:22.946586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:22.971947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8002-b403-443c-9a96-ecdc3805d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:22.972789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8002-b403-443c-9a96-ecdc3805d376 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:22.973070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8002-b403-443c-9a96-ecdc3805d376 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:22.973372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8002-b403-443c-9a96-ecdc3805d376 None admin] PATH_INFO: `/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:22.974534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8002-b403-443c-9a96-ecdc3805d376 None admin] RBAC: Authorizing `identity:get_project(project_id=18e2e72a36ca4027b74e9d22664ce6d5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:22.975966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8002-b403-443c-9a96-ecdc3805d376 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:22.977952 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 569/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:22 2022] GET /identity/v3/projects/18e2e72a36ca4027b74e9d22664ce6d5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:22.984337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:23.084646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e97fc4-2463-40b9-b564-34a0a55fc201 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:23.086979 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:23.118782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:23.119512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:23.119711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:23.119991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:23.120848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] RBAC: Adding query filter params (role.id=1026505750ef4861a26c8da2c19c9fa9, scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5, user.id=b01baa34ba36415a88aa2a044b714eae) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:23.121215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:23.122672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb512-b792-4c86-a9fc-2c3e12d2fe9e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:23.128508 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 561/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:22 2022] GET /identity/v3/role_assignments?user.id=b01baa34ba36415a88aa2a044b714eae&scope.project.id=18e2e72a36ca4027b74e9d22664ce6d5&role.id=1026505750ef4861a26c8da2c19c9fa9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:25.430607 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26dd4-7056-43db-8d69-58b08cbba707 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.431160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26dd4-7056-43db-8d69-58b08cbba707 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.431160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26dd4-7056-43db-8d69-58b08cbba707 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.432531 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 570/1131] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:25.437830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.438229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.438390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.455368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:25.456567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:25.522856 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 562/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:25.547162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26dd4-7056-43db-8d69-58b08cbba707 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:25.647565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26dd4-7056-43db-8d69-58b08cbba707 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:25.684260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c7d1d-323d-4807-bd0c-79c862b5929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:25.685078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7d1d-323d-4807-bd0c-79c862b5929f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.685398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7d1d-323d-4807-bd0c-79c862b5929f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.685676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7d1d-323d-4807-bd0c-79c862b5929f None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.686866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c7d1d-323d-4807-bd0c-79c862b5929f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:25.688304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c7d1d-323d-4807-bd0c-79c862b5929f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:25.689965 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 571/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:25.695787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:25.802187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:25.806240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150955fe-84f6-43b8-8ada-836f749d4a42 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:25.845152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f52190-b3c0-47d5-b1f4-4efd5cd7391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:25.845819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f52190-b3c0-47d5-b1f4-4efd5cd7391a None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.846100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f52190-b3c0-47d5-b1f4-4efd5cd7391a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.846374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f52190-b3c0-47d5-b1f4-4efd5cd7391a None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.847083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f52190-b3c0-47d5-b1f4-4efd5cd7391a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:25.848497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f52190-b3c0-47d5-b1f4-4efd5cd7391a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:25.873886 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 563/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:35:25 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:28.114922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509914-1456-4052-a487-9d16b87c36e2 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:28.115497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509914-1456-4052-a487-9d16b87c36e2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:28.115497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509914-1456-4052-a487-9d16b87c36e2 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:28.116835 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 572/1135] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:28.122579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:28.122967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:28.123134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:28.140247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:28.141469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:28.207689 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 564/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:28.233373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509914-1456-4052-a487-9d16b87c36e2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:28.279713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:28.337110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509914-1456-4052-a487-9d16b87c36e2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:28.372627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc9a9-8793-4e88-85c0-2f5b689a5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:28.373366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc9a9-8793-4e88-85c0-2f5b689a5d89 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:28.373649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc9a9-8793-4e88-85c0-2f5b689a5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:28.373924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc9a9-8793-4e88-85c0-2f5b689a5d89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:28.375104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cc9a9-8793-4e88-85c0-2f5b689a5d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:28.376550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cc9a9-8793-4e88-85c0-2f5b689a5d89 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:28.378215 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 573/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:28.384063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:28.462486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:28.482919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a94b40-9d20-4062-a5da-d5a9a2c763a4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:28.516648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919809a6-60aa-4e09-9e8e-67a16132658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:28.517347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919809a6-60aa-4e09-9e8e-67a16132658d None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:28.517809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919809a6-60aa-4e09-9e8e-67a16132658d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:28.518290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919809a6-60aa-4e09-9e8e-67a16132658d None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:28.519067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919809a6-60aa-4e09-9e8e-67a16132658d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:28.520561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919809a6-60aa-4e09-9e8e-67a16132658d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:28.540580 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 565/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:35:28 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:30.793722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836b36-8f9a-4725-b097-0262efe19772 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:30.794277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836b36-8f9a-4725-b097-0262efe19772 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:30.794277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836b36-8f9a-4725-b097-0262efe19772 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:30.795644 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 574/1139] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:30.800936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:30.801402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:30.801520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:30.818145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:30.819333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:30.885664 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 566/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:30.909871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7836b36-8f9a-4725-b097-0262efe19772 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:31.018237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7836b36-8f9a-4725-b097-0262efe19772 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:31.032154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:31.053852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:31.054572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:31.054852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:31.055126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:31.065208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:31.072726 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:31.073940 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:31.074965 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 575/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:31.080056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:31.155760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:31.191414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de05648-dc11-4900-840d-ecfc7e4a491b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:31.225868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:31.226535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:31.226823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:31.227106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:31.228100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:31.228409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:31.229836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:31.238689 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 567/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:31.244535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:31.344670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f97c53-c823-448c-bd7a-19405b37d95b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:31.378203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:31.379070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:31.379352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:31.379628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] PATH_INFO: `/v3/users/bafbace11903448789ddf929b5230309` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:31.393564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=bafbace11903448789ddf929b5230309)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:31.395144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:31.396824 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 576/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:31 2022] GET /identity/v3/users/bafbace11903448789ddf929b5230309 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:31.403523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:31.513078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a40044-6737-4673-99ba-256909c50be5 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:31.539488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:31.547770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7069428-a31d-47df-85f2-f025203954df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:31.548414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7069428-a31d-47df-85f2-f025203954df None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:31.548697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7069428-a31d-47df-85f2-f025203954df None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:31.548974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7069428-a31d-47df-85f2-f025203954df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:31.615103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7069428-a31d-47df-85f2-f025203954df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:31.616472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7069428-a31d-47df-85f2-f025203954df None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:31.716243 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 568/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:35:31.722135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:31.752467 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:31.821466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6960c2-d11f-4162-8a11-b3acb954b7f1 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:31.855703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309a0df-803a-4dab-a294-d8a382b80a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:31.856534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a0df-803a-4dab-a294-d8a382b80a10 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:31.856816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a0df-803a-4dab-a294-d8a382b80a10 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:31.857093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a0df-803a-4dab-a294-d8a382b80a10 None admin] PATH_INFO: `/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:31.858283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a0df-803a-4dab-a294-d8a382b80a10 None admin] RBAC: Authorizing `identity:get_project(project_id=4c0dbbd6a2ea494eae39b6538ce762a5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:31.859725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a0df-803a-4dab-a294-d8a382b80a10 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:31.861442 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 577/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:31 2022] GET /identity/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:31.867596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7069428-a31d-47df-85f2-f025203954df None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:31.894549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:31.966967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7069428-a31d-47df-85f2-f025203954df None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:32.001255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:32.002595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:32.002595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:32.002595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:32.003770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=4c0dbbd6a2ea494eae39b6538ce762a5, user.id=bafbace11903448789ddf929b5230309) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:32.003770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:32.005678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b471f2-bc11-48c9-929c-37e9d9766f28 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:32.010470 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 569/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:31 2022] GET /identity/v3/role_assignments?user.id=bafbace11903448789ddf929b5230309&scope.project.id=4c0dbbd6a2ea494eae39b6538ce762a5&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:34.221444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62451-1892-41dd-b0a3-349e13bf6adc None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:34.222001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62451-1892-41dd-b0a3-349e13bf6adc None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:34.222001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62451-1892-41dd-b0a3-349e13bf6adc None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:34.223346 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 578/1147] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:34.228927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:34.231090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:34.231090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:34.247330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:34.248545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:34.314893 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 570/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:34.337615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62451-1892-41dd-b0a3-349e13bf6adc None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:34.434462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:34.439511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62451-1892-41dd-b0a3-349e13bf6adc None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:34.474085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:34.474795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:34.475071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:34.475343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:34.485718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:34.493228 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:34.494360 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:34.495400 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 579/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:34.500504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:34.524375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:34.599060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527e0e1-0fc2-45cd-802e-2398f640092a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:34.632889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:34.633578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:34.633868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:34.634149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:34.634897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:34.635208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:34.637231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:34.645255 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 571/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:34.651137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:34.749942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb803b1-b97b-46b9-8d13-cff33731dedb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:34.782487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:34.783350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:34.783631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:34.783905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] PATH_INFO: `/v3/users/bafbace11903448789ddf929b5230309` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:34.785078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] RBAC: Authorizing `identity:get_user(user_id=bafbace11903448789ddf929b5230309)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:34.786535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:34.788147 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 580/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:34 2022] GET /identity/v3/users/bafbace11903448789ddf929b5230309 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:34.793949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:34.878351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:34.894829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac6d66-c115-4d71-8961-6ad7fa107916 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:34.927480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09dba-d789-4ddf-9471-0560ed30fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:34.928327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09dba-d789-4ddf-9471-0560ed30fb1d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:34.928608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09dba-d789-4ddf-9471-0560ed30fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:34.928884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09dba-d789-4ddf-9471-0560ed30fb1d None admin] PATH_INFO: `/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:34.930077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09dba-d789-4ddf-9471-0560ed30fb1d None admin] RBAC: Authorizing `identity:get_project(project_id=4c0dbbd6a2ea494eae39b6538ce762a5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:34.931512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09dba-d789-4ddf-9471-0560ed30fb1d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:34.933815 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 572/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:34 2022] GET /identity/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:34.939899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:34.967265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:35.037927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035a579-66ce-4467-b1eb-45dcf16b4810 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:35.070997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304ab7-d7bf-4b68-b280-eb46bf943d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:35.071867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304ab7-d7bf-4b68-b280-eb46bf943d8d None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:35.072147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304ab7-d7bf-4b68-b280-eb46bf943d8d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:35.072419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304ab7-d7bf-4b68-b280-eb46bf943d8d None admin] PATH_INFO: `/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5/users/bafbace11903448789ddf929b5230309/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:35.074776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304ab7-d7bf-4b68-b280-eb46bf943d8d None admin] RBAC: Authorizing `identity:create_grant(project_id=4c0dbbd6a2ea494eae39b6538ce762a5, user_id=bafbace11903448789ddf929b5230309, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:35.076196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304ab7-d7bf-4b68-b280-eb46bf943d8d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:35.090781 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 581/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:35:34 2022] PUT /identity/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5/users/bafbace11903448789ddf929b5230309/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:37.272173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9535b1-ddb6-4b1f-9713-72e24bf0f5c9 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:37.272780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9535b1-ddb6-4b1f-9713-72e24bf0f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:37.272780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9535b1-ddb6-4b1f-9713-72e24bf0f5c9 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:37.274139 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 573/1154] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:37.279798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:37.280259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:37.280354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:37.297588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:37.298753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:37.366091 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 582/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:37.390101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9535b1-ddb6-4b1f-9713-72e24bf0f5c9 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:37.500791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9535b1-ddb6-4b1f-9713-72e24bf0f5c9 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:37.537057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:37.537794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:37.538078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:37.538356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:37.549805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:37.557462 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:37.558708 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:37.559711 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 574/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:37.564785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:37.582232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:37.666693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8567ed-45a4-45cf-a7ae-80f0d8342781 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:37.702657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:37.703323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:37.703605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:37.703880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:37.704710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:37.705016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:37.706528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:37.718688 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 583/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:37.724550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:37.740965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:37.830420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607f36-5b19-47aa-8d5a-4bf199f6ac81 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:37.867181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:37.868045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:37.868330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:37.868605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] PATH_INFO: `/v3/users/bafbace11903448789ddf929b5230309` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:37.869805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] RBAC: Authorizing `identity:get_user(user_id=bafbace11903448789ddf929b5230309)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:37.871405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:37.873052 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 575/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:37 2022] GET /identity/v3/users/bafbace11903448789ddf929b5230309 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:37.879480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:37.966626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:37.989723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852498-783f-4a05-9c4a-f9356a59b793 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:38.030328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:38.030969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:38.031251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:38.031527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:38.110224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:38.111596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:38.195722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:38.227395 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 584/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:38.233392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:38.318044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:38.338141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa284b4b-10d5-4afb-b2de-96ba6378349f None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:38.373900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b5d2d-1e0f-400c-8dc9-7fa79d586eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:38.374672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b5d2d-1e0f-400c-8dc9-7fa79d586eb8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:38.374958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b5d2d-1e0f-400c-8dc9-7fa79d586eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:38.375225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b5d2d-1e0f-400c-8dc9-7fa79d586eb8 None admin] PATH_INFO: `/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:38.376404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b5d2d-1e0f-400c-8dc9-7fa79d586eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c0dbbd6a2ea494eae39b6538ce762a5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:38.377868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b5d2d-1e0f-400c-8dc9-7fa79d586eb8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:38.379564 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 576/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:38 2022] GET /identity/v3/projects/4c0dbbd6a2ea494eae39b6538ce762a5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:38.385705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:38.499806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd37d-37fe-4950-b04a-691d6c10a86a None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:38.534241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:38.534887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:38.535170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:38.535449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:38.536273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=4c0dbbd6a2ea494eae39b6538ce762a5, user.id=bafbace11903448789ddf929b5230309) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:38.536589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:38.538059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323e1a-82ab-45f3-ae8a-3623d0ef6c68 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:38.543971 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 585/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:38 2022] GET /identity/v3/role_assignments?user.id=bafbace11903448789ddf929b5230309&scope.project.id=4c0dbbd6a2ea494eae39b6538ce762a5&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:40.772718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5d39-e40c-4213-bd27-bd1a75aed473 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:40.773281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5d39-e40c-4213-bd27-bd1a75aed473 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:40.773403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5d39-e40c-4213-bd27-bd1a75aed473 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:40.774729 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 577/1162] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:35:40.780127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:40.780558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:40.780689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:40.797252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:40.798437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:40.833252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:40.866030 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 586/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:40.890134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a5d39-e40c-4213-bd27-bd1a75aed473 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:40.990338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a5d39-e40c-4213-bd27-bd1a75aed473 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:41.023853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:41.024427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:41.024707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:41.024981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:41.042689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:41.091522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:41.092958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:41.189189 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 578/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:41.195252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:41.296625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a5896-3e54-43c7-ba69-b9fd1487da2c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:41.334203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:41.335008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:41.335293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:41.335572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:41.343292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:41.344746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-97bb156f-2b47-4d80-a9da-1dc1ac9c3453 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:41.359876 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:41.361103 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:41.362122 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 587/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:35:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:41.368986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:41.421564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:41.473533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e910fb-255f-4a26-8e13-5be906a3863a None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:41.508939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:41.509625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:41.509907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:41.510183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:41.511159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:41.511470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:41.512828 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e173-da69-4d18-99c6-0b88e193915b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:41.519882 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 579/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Mon May 23 12:35:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:43.707768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae878-f2b5-48d6-93ee-ba9dc2dac14d None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:43.708280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae878-f2b5-48d6-93ee-ba9dc2dac14d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:43.708650 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae878-f2b5-48d6-93ee-ba9dc2dac14d None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:43.711101 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 588/1167] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:43.717475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724a6b-8e3f-4f05-bd42-cf00ea8d0ebb None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:43.717917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724a6b-8e3f-4f05-bd42-cf00ea8d0ebb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:43.718016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724a6b-8e3f-4f05-bd42-cf00ea8d0ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:43.735719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-63724a6b-8e3f-4f05-bd42-cf00ea8d0ebb None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:43.736902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-63724a6b-8e3f-4f05-bd42-cf00ea8d0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:43.805398 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 580/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:43.828245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae878-f2b5-48d6-93ee-ba9dc2dac14d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:43.860775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:43.930899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae878-f2b5-48d6-93ee-ba9dc2dac14d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:43.964590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641cd5-1ed6-4580-831a-51a2a5e7c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:43.965302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641cd5-1ed6-4580-831a-51a2a5e7c507 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:43.965590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641cd5-1ed6-4580-831a-51a2a5e7c507 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:43.965870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641cd5-1ed6-4580-831a-51a2a5e7c507 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:43.966618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641cd5-1ed6-4580-831a-51a2a5e7c507 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:43.968004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641cd5-1ed6-4580-831a-51a2a5e7c507 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:43.983545 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 589/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Mon May 23 12:35:43 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:46.233346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625602-541b-4a58-b9ac-d0ede709f848 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:46.233909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625602-541b-4a58-b9ac-d0ede709f848 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:46.233909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625602-541b-4a58-b9ac-d0ede709f848 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:46.235267 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 581/1170] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:46.240622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:46.241020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:46.241232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:46.258223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:46.259423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:46.325074 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 590/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:46.349485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625602-541b-4a58-b9ac-d0ede709f848 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:46.393960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:46.450120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625602-541b-4a58-b9ac-d0ede709f848 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:46.486264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5203de1-b759-4d55-bc34-ebecab89b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:46.487038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203de1-b759-4d55-bc34-ebecab89b7ff None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:46.487316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203de1-b759-4d55-bc34-ebecab89b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:46.487589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203de1-b759-4d55-bc34-ebecab89b7ff None admin] PATH_INFO: `/v3/domains/0e70e7213c1a4cf888df589d3eab752f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:46.498028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5203de1-b759-4d55-bc34-ebecab89b7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e70e7213c1a4cf888df589d3eab752f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:46.499467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5203de1-b759-4d55-bc34-ebecab89b7ff None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:46.501088 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 582/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Mon May 23 12:35:46 2022] GET /identity/v3/domains/0e70e7213c1a4cf888df589d3eab752f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:46.507009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:46.531288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:46.606721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b820-f6a9-4f74-9831-959470525b34 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:46.640927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b8fe-fac8-4484-aaca-ddc13d3be3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:46.641613 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b8fe-fac8-4484-aaca-ddc13d3be3bd None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:46.641897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b8fe-fac8-4484-aaca-ddc13d3be3bd None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:46.642177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b8fe-fac8-4484-aaca-ddc13d3be3bd None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:46.642892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b8fe-fac8-4484-aaca-ddc13d3be3bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:46.644328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b8fe-fac8-4484-aaca-ddc13d3be3bd None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:46.669602 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 591/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:35:46 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:48.920985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c574f-8fb9-4133-89bc-27f11d469869 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:48.921559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c574f-8fb9-4133-89bc-27f11d469869 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:48.921559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c574f-8fb9-4133-89bc-27f11d469869 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:48.923117 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 583/1174] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:48.928384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:48.928778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:48.928935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:48.946117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:48.947291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:49.013158 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 592/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:49.038409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c574f-8fb9-4133-89bc-27f11d469869 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:49.141152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c574f-8fb9-4133-89bc-27f11d469869 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:49.142742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:49.178027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1ef20-2ff6-4428-9aa4-b56bb42ac99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:49.178809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ef20-2ff6-4428-9aa4-b56bb42ac99b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:49.179090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ef20-2ff6-4428-9aa4-b56bb42ac99b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:49.179363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ef20-2ff6-4428-9aa4-b56bb42ac99b None admin] PATH_INFO: `/v3/domains/0e70e7213c1a4cf888df589d3eab752f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:49.180518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1ef20-2ff6-4428-9aa4-b56bb42ac99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e70e7213c1a4cf888df589d3eab752f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:49.181967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1ef20-2ff6-4428-9aa4-b56bb42ac99b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:49.183837 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 584/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Mon May 23 12:35:49 2022] GET /identity/v3/domains/0e70e7213c1a4cf888df589d3eab752f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:49.189726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:49.192801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:49.288013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a519-1106-4b28-b603-81b55e18f334 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:49.321007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f56fe-a5be-4887-89b1-5d4710cc6618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:49.321692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f56fe-a5be-4887-89b1-5d4710cc6618 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:49.321972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f56fe-a5be-4887-89b1-5d4710cc6618 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:49.322248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f56fe-a5be-4887-89b1-5d4710cc6618 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:49.323717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f56fe-a5be-4887-89b1-5d4710cc6618 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:49.325184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f56fe-a5be-4887-89b1-5d4710cc6618 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:49.345604 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 593/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:35:49 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:51.608088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632038e-a590-4660-b355-81080a912078 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:51.608595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632038e-a590-4660-b355-81080a912078 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:51.608595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632038e-a590-4660-b355-81080a912078 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:51.610308 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 585/1178] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:51.615615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:51.616059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:51.616159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:51.633873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:51.635091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:51.690370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:51.702311 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 594/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:51.727874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632038e-a590-4660-b355-81080a912078 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:51.830350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632038e-a590-4660-b355-81080a912078 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:51.864317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:51.865038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:51.865348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:51.865628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:51.876056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:51.883676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:51.884743 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:51.886079 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 586/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:51.890782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:51.987972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76e61-e88c-4536-b26b-99c13b5fabdd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:52.020616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:52.021303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:52.021586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:52.021863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:52.022597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:52.022904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:52.024273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:52.033085 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 595/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:52.038794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:52.069973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:52.138623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36c725-ad2f-4821-bf8c-cff49722728c None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:52.172056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:52.172904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:52.173205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:52.173478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] PATH_INFO: `/v3/users/db3799ff97554f57a671d7fe1a360153` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:52.186824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] RBAC: Authorizing `identity:get_user(user_id=db3799ff97554f57a671d7fe1a360153)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:52.188247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:52.189929 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 587/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:52 2022] GET /identity/v3/users/db3799ff97554f57a671d7fe1a360153 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:52.195777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:52.248331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:52.294942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223f2e-4f70-4e13-99df-7ae74f56ed9e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:52.327682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:52.328313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:52.328592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:52.328867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:52.399832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:52.401828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:52.452933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:52.501884 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 596/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:52.507748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:52.594837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:52.607141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733c3d-c196-4041-8e4a-59837af0f578 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:52.640511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b583227-6317-4624-bfb7-ba9af8487b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:52.641377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b583227-6317-4624-bfb7-ba9af8487b66 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:52.641657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b583227-6317-4624-bfb7-ba9af8487b66 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:52.641928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b583227-6317-4624-bfb7-ba9af8487b66 None admin] PATH_INFO: `/v3/projects/5fcf8d305add4cfa9b4deddd613555d6` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:52.643088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b583227-6317-4624-bfb7-ba9af8487b66 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcf8d305add4cfa9b4deddd613555d6)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:52.644506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b583227-6317-4624-bfb7-ba9af8487b66 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:52.646211 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 588/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:52 2022] GET /identity/v3/projects/5fcf8d305add4cfa9b4deddd613555d6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:52.653041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:52.750884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6010a-1346-4219-8f42-e4ac3bd06d7f None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:52.785977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:52.786619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:52.786898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:52.787171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:52.787989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=5fcf8d305add4cfa9b4deddd613555d6, user.id=db3799ff97554f57a671d7fe1a360153) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:52.788297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:52.789758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af27250-69f6-4683-a92f-af14d401ca3e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:52.795862 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 597/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:52 2022] GET /identity/v3/role_assignments?user.id=db3799ff97554f57a671d7fe1a360153&scope.project.id=5fcf8d305add4cfa9b4deddd613555d6&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:55.040128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d6ad1-e8d6-43f4-b919-40a821301af7 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.040662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d6ad1-e8d6-43f4-b919-40a821301af7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.040662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d6ad1-e8d6-43f4-b919-40a821301af7 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.042285 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 589/1186] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:55.047563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.047956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.048105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.065412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:55.066580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:55.077924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:55.132981 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 598/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:55.156037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d6ad1-e8d6-43f4-b919-40a821301af7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:55.256267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d6ad1-e8d6-43f4-b919-40a821301af7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:55.289859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:55.290688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.290924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.291862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.302473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:55.310566 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:55.311643 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:35:55.312840 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 590/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:55.317771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:55.418633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488168d-a399-41fd-a643-9b33ef3c3eee None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:55.452438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:55.453162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.453519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.453838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.454573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:55.454884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:55.456476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:55.464798 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 599/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:55.470715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:55.490103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:55.569725 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f44b3-8d93-4ca4-92cd-5ef8e09916c6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:55.602529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:55.603379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.605924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.606219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] PATH_INFO: `/v3/users/db3799ff97554f57a671d7fe1a360153` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.607447 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] RBAC: Authorizing `identity:get_user(user_id=db3799ff97554f57a671d7fe1a360153)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:55.608891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:55.610550 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 591/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:55 2022] GET /identity/v3/users/db3799ff97554f57a671d7fe1a360153 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:55.616347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:55.627763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:55.715957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19afce0-dd53-4ba8-8afd-423487919251 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:55.749994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23014d9-8e6d-4433-876f-025d661268c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:55.750849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23014d9-8e6d-4433-876f-025d661268c1 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.751130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23014d9-8e6d-4433-876f-025d661268c1 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.751406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23014d9-8e6d-4433-876f-025d661268c1 None admin] PATH_INFO: `/v3/projects/5fcf8d305add4cfa9b4deddd613555d6` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.752676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23014d9-8e6d-4433-876f-025d661268c1 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcf8d305add4cfa9b4deddd613555d6)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:55.754153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23014d9-8e6d-4433-876f-025d661268c1 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:55.755849 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 600/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:55 2022] GET /identity/v3/projects/5fcf8d305add4cfa9b4deddd613555d6 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:55.762136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:55.845018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:55.861440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fab47-3e44-4850-a229-0849020d42b2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:55.893472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372c18-39ea-4ec7-8364-9ce2230e06c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:55.894343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372c18-39ea-4ec7-8364-9ce2230e06c6 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:55.894621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372c18-39ea-4ec7-8364-9ce2230e06c6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:55.894895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372c18-39ea-4ec7-8364-9ce2230e06c6 None admin] PATH_INFO: `/v3/projects/5fcf8d305add4cfa9b4deddd613555d6/users/db3799ff97554f57a671d7fe1a360153/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:55.896825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57372c18-39ea-4ec7-8364-9ce2230e06c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcf8d305add4cfa9b4deddd613555d6, user_id=db3799ff97554f57a671d7fe1a360153, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:55.898283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57372c18-39ea-4ec7-8364-9ce2230e06c6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:55.911264 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 592/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:35:55 2022] PUT /identity/v3/projects/5fcf8d305add4cfa9b4deddd613555d6/users/db3799ff97554f57a671d7fe1a360153/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:35:58.082267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a600a-a45d-4b54-9b75-36f27e7fa8ea None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:58.082820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a600a-a45d-4b54-9b75-36f27e7fa8ea None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:58.082820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a600a-a45d-4b54-9b75-36f27e7fa8ea None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:58.084177 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 601/1193] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:58.089448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:58.089820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:58.090010 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:58.106681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:58.107857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:58.172529 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 593/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:35:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:35:58.196095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a600a-a45d-4b54-9b75-36f27e7fa8ea None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:58.272859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:58.298012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a600a-a45d-4b54-9b75-36f27e7fa8ea None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:58.331219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:58.332085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:58.332422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:58.332651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:58.343447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:35:58.351007 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:35:58.352315 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:35:58.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 602/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:35:58.358922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:58.431458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:58.457365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f842-1f4a-4144-add2-9101616bf480 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:58.490738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:58.491398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:58.491677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:58.491952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:58.492680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:58.492983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:58.495065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:58.503058 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 594/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:58.508748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:58.606752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff137bee-15c0-45b3-b78d-fcb64f776aa0 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:58.639665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:58.640510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:58.640786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:58.641056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] PATH_INFO: `/v3/users/db3799ff97554f57a671d7fe1a360153` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:58.642252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] RBAC: Authorizing `identity:get_user(user_id=db3799ff97554f57a671d7fe1a360153)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:58.643690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:58.645329 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 603/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Mon May 23 12:35:58 2022] GET /identity/v3/users/db3799ff97554f57a671d7fe1a360153 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:58.651850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:58.749466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4529e-7fc9-4e86-a08c-10e51853571b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:58.782500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:58.783137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:58.783420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:58.783694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:58.787043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:58.849805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:58.851250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:58.948661 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 595/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:35:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:35:58.954444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:58.958237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:59.054226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0303b-4bd5-48e6-bd0a-a38d61183335 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:59.087219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993a3e-8a9f-432c-8d1c-75e8ad091add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:59.088610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993a3e-8a9f-432c-8d1c-75e8ad091add None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:59.088899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993a3e-8a9f-432c-8d1c-75e8ad091add None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:59.089202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993a3e-8a9f-432c-8d1c-75e8ad091add None admin] PATH_INFO: `/v3/projects/5fcf8d305add4cfa9b4deddd613555d6` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:59.090388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993a3e-8a9f-432c-8d1c-75e8ad091add None admin] RBAC: Authorizing `identity:get_project(project_id=5fcf8d305add4cfa9b4deddd613555d6)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:59.091825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993a3e-8a9f-432c-8d1c-75e8ad091add None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:59.093552 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 604/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Mon May 23 12:35:58 2022] GET /identity/v3/projects/5fcf8d305add4cfa9b4deddd613555d6 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:59.099687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:59.133585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:59.199658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d2a3-0efd-4d4b-97aa-629b05f622ac None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:59.233121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:59.233798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:59.234084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:59.234364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:59.235182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=5fcf8d305add4cfa9b4deddd613555d6, user.id=db3799ff97554f57a671d7fe1a360153) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:59.235496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:59.236926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510936cc-982f-45fc-b280-8e8faf8f89b8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:59.242759 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 596/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:35:59 2022] GET /identity/v3/role_assignments?user.id=db3799ff97554f57a671d7fe1a360153&scope.project.id=5fcf8d305add4cfa9b4deddd613555d6&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:36:09.083289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=64 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:09.240530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=50 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:00.382300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61b8b-2804-4bb9-bfbe-c803375c444a None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:00.382880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61b8b-2804-4bb9-bfbe-c803375c444a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:00.382880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61b8b-2804-4bb9-bfbe-c803375c444a None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:00.385194 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 605/1201] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:00.392814 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:00.393471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:00.393562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:00.414391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:00.415824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:00.508302 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 597/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:00.536268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e61b8b-2804-4bb9-bfbe-c803375c444a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:00.682911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e61b8b-2804-4bb9-bfbe-c803375c444a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:00.724769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:00.725958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:00.726239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:00.726600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:00.738602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:00.740076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:00.761626 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:00.762692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:00.766298 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:00.766298 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:00.766298 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:00.766298 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:00.766298 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 606/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:00.769159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:00.894039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac4ed5-0378-440b-ad60-d373e2faa8e6 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:00.929496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:00.936438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:00.937441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:00.938039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:00.938551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:00.939491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:00.940010 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:00.941657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5988a-3d3c-4f2e-a9dd-63c1aeddaf65 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:00.955963 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 598/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:00.962728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:01.040760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:01.104064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083e911-623a-4946-bf15-76f3f4ec1972 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:01.144610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb1092-bfd8-46c9-ad26-d2eb06c714b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:01.146069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1092-bfd8-46c9-ad26-d2eb06c714b0 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:01.146397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1092-bfd8-46c9-ad26-d2eb06c714b0 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:01.146768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1092-bfd8-46c9-ad26-d2eb06c714b0 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:01.147498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb1092-bfd8-46c9-ad26-d2eb06c714b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:01.152097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb1092-bfd8-46c9-ad26-d2eb06c714b0 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:01.181199 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 607/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Mon May 23 12:37:00 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:37:03.960325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e73d0f-3e5c-42b2-a736-4634c3c7ed24 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:03.960964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e73d0f-3e5c-42b2-a736-4634c3c7ed24 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:03.960964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e73d0f-3e5c-42b2-a736-4634c3c7ed24 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:03.963124 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 599/1206] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:03.969770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:03.970264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:03.970396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:03.988882 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:03.990243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:04.069767 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 608/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:04.105821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e73d0f-3e5c-42b2-a736-4634c3c7ed24 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:04.244267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e73d0f-3e5c-42b2-a736-4634c3c7ed24 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:04.289246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:04.290698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:04.291314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:04.291669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:04.303270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:37:04.311283 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:04.312464 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:04.313984 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 600/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:37:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:04.318598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:04.374246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:04.450540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a77ca2-514f-4bef-a6c4-9fe6be815a9c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:04.489937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:04.490605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:04.490843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:04.491120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:04.491936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:04.492246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:04.494505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:04.509264 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 609/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:37:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:04.515348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:04.583515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:04.654444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b917a-6273-42ce-8401-ac019b5903a7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:04.701575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:04.702386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:04.702706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:04.702986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:04.715184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:04.717879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:04.737837 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:04.738825 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:04.739691 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:04.739691 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:04.739691 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:04.739691 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:04.739691 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 601/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:04.745737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:04.860581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:04.863161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021943aa-e052-4d32-8fd7-6591241c52b6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:04.905052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:04.905682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:04.905966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:04.906242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:04.906966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:04.907273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:04.908666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:04.926780 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 610/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:04.928059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:05.038066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270580b-b3a7-4c53-88bb-d3b90b74e5fb None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:05.040415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:05.085705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:05.087283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:05.088006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:05.088762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] PATH_INFO: `/v3/users/placement` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:05.097502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:05.099289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:37:05.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:05.116864 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:05.118669 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:05.125716 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 602/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:37:05.126721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:05.246947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff1b5c-b9cf-487e-a977-b6263cfb52e9 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:05.287363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:05.288021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:05.288366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:05.288578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:05.291475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:05.291475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:05.291814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:05.310785 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 611/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Mon May 23 12:37:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:05.316638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:05.432808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0108a-1294-4a85-a955-3979f2a0b21d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:05.470783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:05.471474 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:05.471862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:05.472155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:05.510400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:05.559149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:05.560523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:05.692219 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 603/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:37:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:37:05.694038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:05.718179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:05.815901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce0c59-78ea-43d8-8c4a-1aa2e51cb0c6 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:05.860625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:05.861577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:05.861863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:05.862139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:05.876764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:05.878372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:05.898289 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:05.900160 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:05.901249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:05.901249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:05.901249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:05.901249 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:05.901249 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 612/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:05.906224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:05.971073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:06.018606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e369f-2fdb-4a94-9dac-41b84101ae67 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:06.066842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:06.067625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:06.067876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:06.068157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:06.068909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:06.069411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:06.071871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:06.087649 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 604/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:06.094194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:06.184526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:06.229708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb590-2669-4162-acd6-0280c530a95e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:06.276353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:06.277260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:06.277629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:06.277954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:06.285454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:06.286913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:37:06.304577 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:06.306742 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:06.310654 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 613/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:06.312098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:06.436625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646389-020e-432c-be8c-cb603b2d1b37 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:06.463522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:06.480487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:06.481330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:06.481720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:06.482109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:06.482995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:06.483408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:06.485003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08874f-44ad-482f-ac47-2ee0b2d219c9 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:06.498948 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 605/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:06.505261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:06.624627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8cdf5-0ba8-4d24-ab88-c737a7baf885 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:06.661461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:06.670412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:06.671147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:06.671394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:06.671776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:06.672587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=0d0631d051ad40a598b227671ee2ce0f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:06.672903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:06.674386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473234b-8431-4b3e-a1e4-a590b13ece27 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:06.682433 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 614/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:37:06 2022] GET /identity/v3/role_assignments?user.id=0d0631d051ad40a598b227671ee2ce0f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:09.014835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad96bf7-51a3-4efa-8220-46e05ccbc59f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:09.015456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad96bf7-51a3-4efa-8220-46e05ccbc59f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:09.015456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad96bf7-51a3-4efa-8220-46e05ccbc59f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:09.016954 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 606/1220] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:37:09.022067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:09.022559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:09.022653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:09.040699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:09.042060 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:09.118270 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 615/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:09.143479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad96bf7-51a3-4efa-8220-46e05ccbc59f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:09.256437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad96bf7-51a3-4efa-8220-46e05ccbc59f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:09.296776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:09.297543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:09.297833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:09.298114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:09.309589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:37:09.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:09.318374 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:37:09.319208 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:09.320314 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 607/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:37:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:09.325337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:09.437793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b62bb-ab8a-4b94-8730-1e992ffe0e0e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:09.466802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:09.481021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:09.481722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:09.482157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:09.482437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:09.483430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] RBAC: Adding query filter params (name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:09.483744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:09.485539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:09.495858 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 616/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:37:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:37:09.502619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:09.550627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:09.623096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dd9df-07f6-48a9-ba92-dd41b31520ce None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:09.664617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:09.665800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:09.666088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:09.666370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:09.678678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:09.680844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:09.700817 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:09.702135 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:09.703454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:09.703454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:09.703454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:09.703454 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:09.703454 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 608/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:09.708024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:09.833558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a79a-4f6d-48d8-8cb0-25d8c532a2bb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:09.872893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:09.873762 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:09.874035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:09.874313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:09.875033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:09.875490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:09.876989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:09.890850 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 617/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:09.896558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:09.999774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:10.009308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a217-1a3f-4fce-b5d7-9add65f92a74 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:10.047063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:10.047929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:10.048217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:10.048502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:10.056674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:10.058324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:37:10.075143 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:10.076429 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:10.077676 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 609/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:10.083267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:10.140614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:10.204218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece854d-4439-43e6-b997-e3d29e65a1ba None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:10.239786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:10.240454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:10.240734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:10.241013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:10.241887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:10.242273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:10.244482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:10.262973 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 618/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Mon May 23 12:37:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:10.269260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:10.391692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd455f-4005-451d-a783-c115c84be7b2 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:10.430497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:10.431573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:10.431857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:10.432136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:10.443970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:10.445493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:10.464046 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:10.465328 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:10.466342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:10.466342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:10.466342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:10.466342 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:10.466342 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 610/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:10.471143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:10.583118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819cb2-99ff-426e-a7e3-80a9c120a22d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:10.587580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:10.630793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:10.631505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:10.631787 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:10.632064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:10.632828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:10.633708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:10.635298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:10.650500 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 619/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:37:10.656285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:10.668503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:10.772843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8a3a-8488-4195-91a8-a9d2b8726b1b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:10.809568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:10.810404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:10.810730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:10.811055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:10.818283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:10.819723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:37:10.835657 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:10.837554 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:10.838475 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 611/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:10.845022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:10.965880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0bd1-9c15-44f6-8225-a51e73b0ea24 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:11.005381 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:11.006325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:11.006652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:11.007022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:11.008124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:11.009065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:11.010558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d17e-0f66-4dfe-860b-add7dc351e96 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:11.023984 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 620/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:11.030114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:11.108186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:11.145746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09428-2407-4d9d-93f9-517fe06b5283 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:11.183274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3f6a4-364b-472f-8fa1-9dc7b21bfcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:11.184158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f6a4-364b-472f-8fa1-9dc7b21bfcb4 None admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:11.184441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f6a4-364b-472f-8fa1-9dc7b21bfcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:11.184715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f6a4-364b-472f-8fa1-9dc7b21bfcb4 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/0d0631d051ad40a598b227671ee2ce0f/roles/8ca1745600b948799ce70e883dfe0740` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:11.201361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3f6a4-364b-472f-8fa1-9dc7b21bfcb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=0d0631d051ad40a598b227671ee2ce0f, role_id=8ca1745600b948799ce70e883dfe0740)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:11.202806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3f6a4-364b-472f-8fa1-9dc7b21bfcb4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:11.215409 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 612/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:37:11 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/0d0631d051ad40a598b227671ee2ce0f/roles/8ca1745600b948799ce70e883dfe0740 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:37:13.473973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e129-36bf-44f3-acf5-8b7dfa0a00eb None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:13.474765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e129-36bf-44f3-acf5-8b7dfa0a00eb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:13.474765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e129-36bf-44f3-acf5-8b7dfa0a00eb None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:13.476287 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 621/1233] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:13.482486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:13.482921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:13.483075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:13.500437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:13.501719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:13.575016 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 613/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:13.600056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e129-36bf-44f3-acf5-8b7dfa0a00eb None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:13.627844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:13.714453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e129-36bf-44f3-acf5-8b7dfa0a00eb None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:13.749130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:13.749952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:13.750228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:13.750522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:13.761858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:37:13.769499 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:13.770642 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:13.777385 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 622/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Mon May 23 12:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:13.778262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:13.829041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:13.888188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089246-cd34-4c19-aa6c-1c7a9fc7487f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:13.926482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:13.927244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:13.927555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:13.927813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:13.928559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:13.928860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:13.931038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:13.940022 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 614/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Mon May 23 12:37:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:13.946587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:14.047011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:14.068428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326efec-caa5-4bb6-9de4-5db35f570ac7 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:14.110783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:14.111577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:14.111873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:14.112139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:14.124511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:14.126693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:14.147407 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:14.148489 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:14.149456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:14.149456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:14.149456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:14.149456 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:14.149456 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 623/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:37:14.154688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:14.272508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572902be-5def-4442-8e99-06b78943c2d7 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:14.283915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:14.314495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:14.315186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:14.315466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:14.315739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:14.316455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:14.316753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:14.318286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:14.331151 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 615/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:14.336672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:14.449714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695c1fe-1bdc-4dc8-8156-3803080fa89b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:14.489843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:14.490653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:14.490936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:14.491211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] PATH_INFO: `/v3/users/placement` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:14.497712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:14.504674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:14.506329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:37:14.522448 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:14.523679 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:14.524696 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 624/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:37:14.530095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:14.643421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0851cd-83b2-4ab5-9352-b64682ec7177 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:14.683569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:14.684249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:14.684538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:14.684820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:14.685719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:14.686037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:14.687506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:14.711626 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 616/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Mon May 23 12:37:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:37:14.713241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:14.827237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee292f02-c3a6-474a-9f33-dd231b2dc33c None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:14.863246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:14.863898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:14.864196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:14.864467 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:14.929897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:14.942130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:14.943603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:15.067559 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 625/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:37:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:37:15.075849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:15.112419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:15.195094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba391-e3e2-44b8-8fd1-157b91df25d6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:15.233467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:15.234580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:15.234847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:15.235190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:15.247100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:15.248563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:15.269089 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:15.270193 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:15.271113 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:15.271113 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:15.271113 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:15.271113 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:15.271113 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 617/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:15.277093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:15.375429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:15.381369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a51d62-65ac-4246-be49-cfd4ef21b640 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:15.421353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:15.422020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:15.422359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:15.422676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:15.423480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:15.423844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:15.425398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:15.438353 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 626/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:15.444997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:15.532340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:15.555983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473da4-81a6-4608-b102-0426a438c309 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:15.597394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:15.598277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:15.598628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:15.598910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:15.607230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:15.608683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:37:15.625667 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:15.626767 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:15.627802 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 618/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:37:15.634129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:15.746123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca52e-772a-4ed3-a479-638508751f12 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:15.782067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:15.782731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:15.783017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:15.783297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:15.784086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:15.784401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:15.785884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c60bd-ac32-46f6-b615-bc83f00c8655 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:15.798410 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 627/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:15.805470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:15.923024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a5a2b-355e-4030-a0bb-ca866b41c4c3 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:15.957719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:15.958379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:15.958667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:15.958990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:15.959777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] RBAC: Adding query filter params (role.id=8ca1745600b948799ce70e883dfe0740, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=0d0631d051ad40a598b227671ee2ce0f) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:15.960092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:15.962211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5c8cf-5469-42ed-9ee0-2bdf0f9cecd4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:15.968758 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 619/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:37:15 2022] GET /identity/v3/role_assignments?user.id=0d0631d051ad40a598b227671ee2ce0f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=8ca1745600b948799ce70e883dfe0740 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:18.367066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b28a7-c1ba-4a3c-9197-a20251514660 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:18.368249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b28a7-c1ba-4a3c-9197-a20251514660 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:18.368687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b28a7-c1ba-4a3c-9197-a20251514660 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:18.370386 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 628/1247] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:18.375967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:18.376430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:18.376555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:18.381986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:18.395915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:18.397312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:18.474885 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 620/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:18.500379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b28a7-c1ba-4a3c-9197-a20251514660 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:18.520486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:18.614857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b28a7-c1ba-4a3c-9197-a20251514660 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:18.653453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:18.654354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:18.654714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:18.654993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:18.666839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:37:18.674588 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:18.675705 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:18.676597 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 629/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:18.682194 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:18.789387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7b50-81f1-4d38-b4d6-703dcb7b1627 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:18.819488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:18.826143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:18.826838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:18.827126 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:18.827421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:18.828157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:18.828466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:18.829885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:18.839041 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 621/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:37:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:18.844667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:18.929324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:18.956334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b369f-dba0-4087-884b-b2d0d1b53d73 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:18.996559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:18.997628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:18.997977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:18.998322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:19.011473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:19.012946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:19.031868 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:19.032970 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:19.033953 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:19.033953 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:19.033953 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:19.033953 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:19.033953 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 630/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:19.038830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:19.154515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2987ae-cd82-4854-bc19-178fb70f67ab None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:19.190145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:19.190736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:19.191019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:19.191296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:19.192005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:19.192309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:19.193713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:19.207386 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 622/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:19.213862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:19.327009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3a82-b2b9-4ec7-bea3-ef3540746df8 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:19.363206 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:19.372604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:19.373464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:19.373867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:19.374108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] PATH_INFO: `/v3/users/placement` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:19.382844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:19.385324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:37:19.402563 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:19.403714 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:19.404713 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 631/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:19.409825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:19.471656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:19.521290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba652a-adb7-4a4f-8861-ec31d1b1be82 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:19.559315 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:19.560006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:19.560299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:19.560584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:19.561475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:19.561793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:19.563263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:19.582214 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 623/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Mon May 23 12:37:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:19.588819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:19.698280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b461-9421-482f-afce-c8324d295cdb None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:19.735221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:19.735793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:19.736074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:19.736349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:19.796945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:19.810010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:19.811485 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:19.913353 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 632/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:37:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:37:19.919295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:20.023852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f8dd-be97-4191-8754-5c3922efc289 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:20.038489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:20.061132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:20.062002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:20.062286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:20.062638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:20.074855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:20.076326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:20.097589 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:20.098641 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:20.100087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:20.100087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:20.100087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:20.100087 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:20.100087 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 624/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:20.105285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:20.191212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:20.203901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f27f-74ed-493a-8bd4-7608f337a786 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:20.236635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:20.237318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:20.237603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:20.237880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:20.238597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:20.238902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:20.240270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:20.252013 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 633/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:20.257640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:20.356040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1373856-e954-462e-aa1c-28358a02df04 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:20.389389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:20.390166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:20.390442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:20.390711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:20.397111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:20.398799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:37:20.412162 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:20.413659 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:20.415379 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 625/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:20.420330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:20.518401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e99d6-75cb-43e8-bb51-dca7ce1c0461 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:20.550865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:20.551497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:20.551775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:20.552046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:20.552815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:20.553120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:20.554667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138d41f-e4a7-4534-998a-fc5801e854a7 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:20.567483 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 634/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:20.573690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:20.599176 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:20.673636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d822-23af-4445-824d-ad727a0f4c3b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:20.716052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:20.716697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:20.716978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:20.717283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:20.718107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=0d0631d051ad40a598b227671ee2ce0f) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:20.718419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:20.719854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a5364-f540-4cd0-b72e-1ae1ffe8f0ce None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:20.725517 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 626/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:37:20 2022] GET /identity/v3/role_assignments?user.id=0d0631d051ad40a598b227671ee2ce0f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:22.921845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbea36d-28a5-4aa0-b9e2-a65a7469a701 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:22.922551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbea36d-28a5-4aa0-b9e2-a65a7469a701 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:22.922551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbea36d-28a5-4aa0-b9e2-a65a7469a701 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:22.923800 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 635/1261] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:22.929163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:22.929609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:22.929769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:22.946911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:22.948115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:23.014033 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 627/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:23.037177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbea36d-28a5-4aa0-b9e2-a65a7469a701 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:23.048437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:23.147564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbea36d-28a5-4aa0-b9e2-a65a7469a701 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:23.181278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:23.181977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:23.182253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:23.182523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:23.193894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:37:23.202802 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:23.203879 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:23.204776 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 636/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:23.210000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:23.228450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:23.307618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4088a-9b7c-40cf-883b-aa361e313f86 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:23.339872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:23.340535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:23.340815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:23.341089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:23.341855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:23.342160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:23.343523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:23.352409 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 628/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:23.358157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:23.422995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:23.457309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57b3f8-6baa-4b1a-90fe-9778a0a7376b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:23.489531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:23.490298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:23.490575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:23.490847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:23.501521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:23.502955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:23.519362 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:23.520413 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:23.521344 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:23.521344 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:23.521344 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:23.521344 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:23.521344 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 637/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:37:23.526319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:23.606229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:23.625564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fdca2-d0dc-4bef-8c8e-5a37713b6a8b None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:23.658896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:23.659550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:23.659834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:23.660110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:23.660822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:23.661127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:23.662544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:23.674871 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 629/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:23.680621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:23.789544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e46d44-44d5-467f-ac87-746be394a5ac None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:23.808287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:23.822446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:23.823245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:23.823519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:23.823791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] PATH_INFO: `/v3/users/placement` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:23.831139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:23.832574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:37:23.847401 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:23.848522 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:23.850014 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 638/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:23.855510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:23.953732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49eeff-0912-4a94-9c81-62103a34bbab None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:23.988083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:23.988746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:23.989034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:23.989340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:23.990177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:23.990486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:23.991930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:24.000392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:24.009495 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 630/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Mon May 23 12:37:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:24.015070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:24.119002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d44976-1f90-468d-af23-2eda04b82910 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:24.152192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:24.152975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:24.153285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:24.153565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:24.163831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:24.165362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:24.182322 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:24.183350 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:24.184346 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:24.184346 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:24.184346 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:24.184346 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:24.184346 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 639/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:24.189200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:24.288439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff77cf-3606-442f-b619-355d4467cac6 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:24.322191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:24.322859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:24.323141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:24.323414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:24.324117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:24.324419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:24.325829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:24.337745 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 631/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:24.343428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:24.376126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:24.443537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74eb42-4ccd-4254-b905-9662aca89242 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:24.476775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:24.477576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:24.477857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:24.478130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:24.484621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:24.486117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:37:24.500636 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:24.501692 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:24.507394 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 640/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:24.508631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:24.564906 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:24.606172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10949fa-1c2d-42f6-b2e7-103f81ea8dda None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:24.640022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:24.640602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:24.640881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:24.641178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:24.641962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:24.642271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:24.643685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78453b63-77d0-4473-94de-52cbceea4c88 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:24.655668 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 632/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:24.661712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:24.762305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:24.771263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e80f3-72fa-45f9-b9b9-de61e939d7c3 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:24.805675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca49d88-cdf0-41ec-9499-865047f603b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:24.806564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49d88-cdf0-41ec-9499-865047f603b5 None admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:24.806846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49d88-cdf0-41ec-9499-865047f603b5 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:24.807120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49d88-cdf0-41ec-9499-865047f603b5 None admin] PATH_INFO: `/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/0d0631d051ad40a598b227671ee2ce0f/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:24.809064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca49d88-cdf0-41ec-9499-865047f603b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=57d34277a6614a6bb94d5323b6d8d3e8, user_id=0d0631d051ad40a598b227671ee2ce0f, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:24.810532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca49d88-cdf0-41ec-9499-865047f603b5 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:24.822708 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 641/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Mon May 23 12:37:24 2022] PUT /identity/v3/projects/57d34277a6614a6bb94d5323b6d8d3e8/users/0d0631d051ad40a598b227671ee2ce0f/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:37:27.019541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4f4e-bdb7-4ae6-b3ca-b61d32afcca2 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.020152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4f4e-bdb7-4ae6-b3ca-b61d32afcca2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.020152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4f4e-bdb7-4ae6-b3ca-b61d32afcca2 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.021497 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 633/1274] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:27.026674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.027056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.027233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.044110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:27.045317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:27.117763 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 642/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:27.142408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4f4e-bdb7-4ae6-b3ca-b61d32afcca2 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:27.243909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4f4e-bdb7-4ae6-b3ca-b61d32afcca2 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:27.260971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:27.277702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:27.278425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.278706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.278980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.289354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:37:27.296930 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:27.298047 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:27.299095 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 634/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Mon May 23 12:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:27.304082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:27.389115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:27.407965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49574-942f-4b88-abba-3ccd1b124524 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:27.441438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:27.442099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.442383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.442662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.443401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] RBAC: Adding query filter params (name=admin) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:27.443709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:27.445121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:27.453029 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 643/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Mon May 23 12:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:27.458713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:27.558809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fceb3-e6e9-470c-ad13-ed5ef0e03296 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:27.591876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:27.592659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.592944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.593249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.605180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:27.606628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:27.623457 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:27.624430 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:27.625407 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:27.625407 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:27.625407 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:27.625407 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:27.625407 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 635/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:27.630412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:27.730661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443008-631d-4ace-ad97-64f63ffe100e None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:27.763249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:27.763989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.764184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.764463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.765194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:27.765507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:27.766875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:27.778541 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 644/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:27.784173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:27.816015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:27.883232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758532-ef16-447d-a8ff-dde3e06bff20 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:27.915984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:27.916764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:27.917045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:27.917347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] PATH_INFO: `/v3/users/placement` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:27.924622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:27.926084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:37:27.940079 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:27.941186 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:27.946859 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 636/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:27.947570 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:27.951277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.046765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cdeef-a623-4e20-b874-ad3b0ee5afa4 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:28.082493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:28.083082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:28.083361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:28.083635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:28.084454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:28.084759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:28.086945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:28.103880 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 645/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Mon May 23 12:37:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:37:28.109633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:28.198301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.207984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea9e4-1db3-4d0b-b8b4-74f8d4ca1373 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:28.240276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:28.240905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:28.241214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:28.241492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:28.306831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:28.308263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:28.396476 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.407387 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 637/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Mon May 23 12:37:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:37:28.413092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:28.472903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.511642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678cded-7392-46e7-92a0-63bd30e6b78d None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:28.544294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:28.545066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:28.545370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:28.545646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:28.555937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:28.557412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:37:28.574388 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:28.575330 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:28.576459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:37:28.576459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:37:28.576459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:37:28.576459 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:28.576459 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 646/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:28.581330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:28.679068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97b1a-fe56-4a76-93b8-5f97510e564d None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:28.712066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:28.712719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:28.712997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:28.713311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:28.714018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:28.714322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:28.715669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:28.727606 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 638/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Mon May 23 12:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:37:28.733302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:28.830948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224db6d7-8e34-4a06-8bca-50f1e0c49a37 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:28.844606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.865018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:28.865822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:28.866105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:28.866385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:28.873712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:28.875155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:37:28.888647 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application with Lock( May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:28.889701 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: ERROR keystone.server.flask.application May 23 12:37:28.890784 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 647/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Mon May 23 12:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:28.895627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:28.945268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.996113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899049-e2ea-40a7-a32e-b9a01239b644 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:29.028836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:29.029512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:29.029792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:29.030062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:29.030831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:29.031151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:29.032556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b9218-7530-4b8c-acec-a15394e59b9e None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:29.045742 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 639/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Mon May 23 12:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:29.051818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:29.150813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0aad2-4bf2-43b0-a212-77694d42ff74 None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:29.183593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:29.184228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:29.184507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:29.184782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:29.185710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] RBAC: Adding query filter params (role.id=5e4eaa0fc481419bb2ae62db863607d1, scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8, user.id=0d0631d051ad40a598b227671ee2ce0f) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:29.185954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:29.187383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bbcb-1941-469d-ae9b-0d302bdce169 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:29.193091 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 648/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Mon May 23 12:37:29 2022] GET /identity/v3/role_assignments?user.id=0d0631d051ad40a598b227671ee2ce0f&scope.project.id=57d34277a6614a6bb94d5323b6d8d3e8&role.id=5e4eaa0fc481419bb2ae62db863607d1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:31.408335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e4a6-cdc0-4abf-9e3e-68ebb7c86535 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:31.408849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e4a6-cdc0-4abf-9e3e-68ebb7c86535 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:31.408936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e4a6-cdc0-4abf-9e3e-68ebb7c86535 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:31.410317 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 640/1288] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:31.416305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:31.416758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:31.416973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:31.433711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:31.434910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:31.464631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:31.505801 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 649/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:31.533490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e4a6-cdc0-4abf-9e3e-68ebb7c86535 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:31.634811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e4a6-cdc0-4abf-9e3e-68ebb7c86535 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:31.645304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:31.669652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:31.670443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:31.670725 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:31.670999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] PATH_INFO: `/v3/services/placement` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:31.671646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:31.673006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:31.684754 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:31.685984 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:31.687257 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 641/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:37:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:31.692019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:31.791026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c24f1-daaa-42dd-8001-d4c79c0b3b14 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:31.823777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:31.824429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:31.824734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:31.825013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:31.825743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] RBAC: Adding query filter params (name=placement) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:31.826054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:31.827447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247563-52be-48d8-a230-7aa62cb87c09 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:31.832208 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 650/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Mon May 23 12:37:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:31.838737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:31.936455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750161f-6351-414c-8f6e-4123c0bf1332 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:31.969043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:31.969719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:31.970005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:31.970284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] PATH_INFO: `/v3/services` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:31.970984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] RBAC: Adding query filter params (type=placement) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:31.971288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:31.972646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c17c95-24d6-456a-8280-7b6a0468d4ad None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:31.977400 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 642/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Mon May 23 12:37:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:34.231044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe266b-6077-42be-a092-cd1ea3e735a0 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:34.231601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe266b-6077-42be-a092-cd1ea3e735a0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:34.231601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe266b-6077-42be-a092-cd1ea3e735a0 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:34.232968 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 651/1293] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:34.238043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c0f25-ec57-4bf4-a9f5-6492030692e3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:34.238438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c0f25-ec57-4bf4-a9f5-6492030692e3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:34.238602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c0f25-ec57-4bf4-a9f5-6492030692e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:34.255290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-073c0f25-ec57-4bf4-a9f5-6492030692e3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:34.256473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-073c0f25-ec57-4bf4-a9f5-6492030692e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:34.286461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:34.323007 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 643/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:34.346213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe266b-6077-42be-a092-cd1ea3e735a0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:34.377774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:34.447290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe266b-6077-42be-a092-cd1ea3e735a0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:34.481111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1cdd2-4f93-4556-ae8c-96d8bc636d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:34.481719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1cdd2-4f93-4556-ae8c-96d8bc636d32 None admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:34.481995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1cdd2-4f93-4556-ae8c-96d8bc636d32 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:34.482266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1cdd2-4f93-4556-ae8c-96d8bc636d32 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:34.482963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1cdd2-4f93-4556-ae8c-96d8bc636d32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:34.484332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1cdd2-4f93-4556-ae8c-96d8bc636d32 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:34.497228 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 652/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Mon May 23 12:37:34 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:37:36.713731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a52b0-c3bb-4292-8099-60ab221f81e0 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:36.714298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a52b0-c3bb-4292-8099-60ab221f81e0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:36.714298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a52b0-c3bb-4292-8099-60ab221f81e0 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:36.715768 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 644/1296] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:36.721073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:36.721534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:36.721656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:36.738774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:36.739944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:36.810187 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 653/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:36.833709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a52b0-c3bb-4292-8099-60ab221f81e0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:36.933650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a52b0-c3bb-4292-8099-60ab221f81e0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:36.967015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:36.967769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:36.968051 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:36.968327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] PATH_INFO: `/v3/services/placement` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:36.968971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:36.970355 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:36.982338 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:36.983550 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:36.984438 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 645/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:37:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:36.989860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:37.008656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:37.093058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbba5c-ff69-4266-b9be-0c78fca08918 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:37.126654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:37.127282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:37.127561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:37.127831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:37.128519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] RBAC: Adding query filter params (name=placement) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:37.128820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:37.130222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:37.136191 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 654/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Mon May 23 12:37:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:37.142197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:37.173754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:37.242067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27020b-bc8d-4127-9200-0d918b51d138 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:37.274683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:37.275322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:37.275603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:37.275877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:37.276654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] RBAC: Adding query filter params (interface=public, service_id=2e332fb58daa4bdf977a75e7a2335325, region_id=RegionOne) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:37.276967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:37.278360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d94e-38ef-4e92-ae87-7aa582383bb8 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:37.283265 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 646/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Mon May 23 12:37:37 2022] GET /identity/v3/endpoints?service_id=2e332fb58daa4bdf977a75e7a2335325&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:37:37.289393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:37.370350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:37.388624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950798a0-032e-4d4f-b657-6d767a9b800b None admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:37.421339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415510e-793a-4fca-b2c2-4952ab514ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:37.421995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415510e-793a-4fca-b2c2-4952ab514ddf None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:37.422280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415510e-793a-4fca-b2c2-4952ab514ddf None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:37.422557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415510e-793a-4fca-b2c2-4952ab514ddf None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:37.423227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415510e-793a-4fca-b2c2-4952ab514ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:37.424605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415510e-793a-4fca-b2c2-4952ab514ddf None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:37.432007 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 655/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Mon May 23 12:37:37 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:37:39.610651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774087b-edce-4984-bcfa-d06821364597 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:39.611191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774087b-edce-4984-bcfa-d06821364597 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:39.611191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774087b-edce-4984-bcfa-d06821364597 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:39.612500 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 647/1302] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:37:39.618081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:39.618533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:39.618630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:39.635676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:39.636868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:39.702126 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 656/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:37:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:37:39.724875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774087b-edce-4984-bcfa-d06821364597 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:39.818107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:39.825956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774087b-edce-4984-bcfa-d06821364597 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:39.860293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:39.861132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:39.861389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:39.861657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:39.862291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:39.863637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:37:39.875365 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:37:39.876525 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application with Lock( May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self._enter() May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application return self.creator() May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application created_value = creator( May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: ERROR keystone.server.flask.application May 23 12:37:39.877587 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 648/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Mon May 23 12:37:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:37:39.883344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:39.965042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:39.987623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e18ff-3299-4f98-9cc3-9ca8c4eaf094 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:40.020289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:40.020942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:40.021252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:40.021530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] PATH_INFO: `/v3/services` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:40.022224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] RBAC: Adding query filter params (name=placement) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:40.023219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:40.024649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb7315-2007-4b61-a0bf-48b17d00a276 None admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:40.029627 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 657/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Mon May 23 12:37:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:40.035302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:40.133448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b217-ea4c-4262-a078-84df0e2da8a4 None admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:40.166330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e807e61-8018-40a3-abf1-467aa8a0d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:40.166969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e807e61-8018-40a3-abf1-467aa8a0d6eb None admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:40.167254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e807e61-8018-40a3-abf1-467aa8a0d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:40.167532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e807e61-8018-40a3-abf1-467aa8a0d6eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:40.168261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e807e61-8018-40a3-abf1-467aa8a0d6eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:40.169640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e807e61-8018-40a3-abf1-467aa8a0d6eb None admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:40.187593 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 649/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Mon May 23 12:37:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:37:50.026638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=30 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:50.183346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:44.740794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a04c-7c4a-4144-a492-d708768b853d None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:44.741311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a04c-7c4a-4144-a492-d708768b853d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:44.741311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a04c-7c4a-4144-a492-d708768b853d None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:44.747844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425b3ef-7a4f-4414-9ff3-b2dec2765e99 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:44.748241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425b3ef-7a4f-4414-9ff3-b2dec2765e99 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:44.748380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425b3ef-7a4f-4414-9ff3-b2dec2765e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:44.751796 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 658/1307] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:38:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:44.848393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4425b3ef-7a4f-4414-9ff3-b2dec2765e99 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:44.849672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4425b3ef-7a4f-4414-9ff3-b2dec2765e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:44.971952 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 650/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:38:45.024412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276938b6-1b97-429f-9a97-e64171e7a85c None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:45.024954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276938b6-1b97-429f-9a97-e64171e7a85c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:45.025287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276938b6-1b97-429f-9a97-e64171e7a85c None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:45.026670 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 659/1309] 10.222.0.45 () {54 vars in 964 bytes} [Mon May 23 12:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:45.033760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a1d7-5b52-4b55-9d3f-8123f795ef55 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:45.034058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a1d7-5b52-4b55-9d3f-8123f795ef55 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:45.034344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a1d7-5b52-4b55-9d3f-8123f795ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:45.117724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-6003a1d7-5b52-4b55-9d3f-8123f795ef55 None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:45.118879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6003a1d7-5b52-4b55-9d3f-8123f795ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:45.140972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:45.200839 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 651/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Mon May 23 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:45.210358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276938b6-1b97-429f-9a97-e64171e7a85c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:45.212184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-276938b6-1b97-429f-9a97-e64171e7a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:45.331230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276938b6-1b97-429f-9a97-e64171e7a85c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:45.418303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:45.419083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:45.419684 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:45.419808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:45.422005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:45.486839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:45.547950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:45.549447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebf443-3023-4af5-80ff-4386daaa2f65 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:45.570562 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 660/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:38:48.083910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541971d3-3445-46bd-83df-a381830292ea None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:48.085326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541971d3-3445-46bd-83df-a381830292ea None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:48.085807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541971d3-3445-46bd-83df-a381830292ea None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:48.091318 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 652/1312] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:38:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:48.093068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690918-d116-4c41-9d32-7f467e2a78a5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:48.093867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690918-d116-4c41-9d32-7f467e2a78a5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:48.094379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690918-d116-4c41-9d32-7f467e2a78a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:48.176701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f1690918-d116-4c41-9d32-7f467e2a78a5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:48.178831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f1690918-d116-4c41-9d32-7f467e2a78a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:48.290648 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 661/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:48.328946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541971d3-3445-46bd-83df-a381830292ea None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:48.330766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-541971d3-3445-46bd-83df-a381830292ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:48.445057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541971d3-3445-46bd-83df-a381830292ea None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:48.521186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:48.524650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:48.525359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:48.526043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:48.526676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:48.528753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:48.646301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:48.648237 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38003c63-1a7a-445c-9213-6d2d6febaefd service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:48.677335 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 653/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:51.274848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc791-573f-476e-a756-2731cbfe3198 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:51.275351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc791-573f-476e-a756-2731cbfe3198 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:51.275351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cc791-573f-476e-a756-2731cbfe3198 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:51.276690 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 662/1315] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:51.281911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44156b-b394-49b6-8cd6-76bf627d102b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:51.282324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44156b-b394-49b6-8cd6-76bf627d102b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:51.282551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44156b-b394-49b6-8cd6-76bf627d102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:51.353397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ab44156b-b394-49b6-8cd6-76bf627d102b None None] MFA Rules not processed for user `cf544868838942a889971356face3a45`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:51.354636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ab44156b-b394-49b6-8cd6-76bf627d102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:51.407500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:51.452762 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 654/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:51.492786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cc791-573f-476e-a756-2731cbfe3198 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:51.494384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1e1cc791-573f-476e-a756-2731cbfe3198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:51.504239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:51.597218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cc791-573f-476e-a756-2731cbfe3198 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:51.672869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:51.673567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:51.673852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:51.674129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:51.675801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:51.738376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:51.785555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:51.787019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeadbd4-2c78-4a11-905c-50a766953b68 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:51.805646 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 663/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:38:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:54.564724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80d2c-46d7-4429-81e3-409707d02f07 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:54.565341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80d2c-46d7-4429-81e3-409707d02f07 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:54.565341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80d2c-46d7-4429-81e3-409707d02f07 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:54.566674 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 655/1318] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:54.572322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0c3a-cb6a-44c5-8501-d2b7e17e86c6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:54.572806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0c3a-cb6a-44c5-8501-d2b7e17e86c6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:54.572914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0c3a-cb6a-44c5-8501-d2b7e17e86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:54.637943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-80da0c3a-cb6a-44c5-8501-d2b7e17e86c6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:54.639099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-80da0c3a-cb6a-44c5-8501-d2b7e17e86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:54.735757 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 664/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:38:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:54.797091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dcffb-dc70-49de-b452-dc306c3afaac None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:54.797433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dcffb-dc70-49de-b452-dc306c3afaac None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:54.797714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dcffb-dc70-49de-b452-dc306c3afaac None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:54.799093 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 656/1320] 10.222.0.45 () {54 vars in 964 bytes} [Mon May 23 12:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:38:54.805801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99886a9-5631-4bcb-b008-39e008d6962b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:54.806088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99886a9-5631-4bcb-b008-39e008d6962b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:54.806367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99886a9-5631-4bcb-b008-39e008d6962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:54.828330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:54.882211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d99886a9-5631-4bcb-b008-39e008d6962b None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:54.883522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d99886a9-5631-4bcb-b008-39e008d6962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:54.958252 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 665/1321] 10.222.0.45 () {58 vars in 1061 bytes} [Mon May 23 12:38:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:54.967930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dcffb-dc70-49de-b452-dc306c3afaac None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:54.969543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-437dcffb-dc70-49de-b452-dc306c3afaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:55.073523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dcffb-dc70-49de-b452-dc306c3afaac None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:55.146253 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:55.147424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:55.147713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:55.147992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:55.149690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:55.157057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:55.258913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:55.260343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b4618-45a5-4bcb-ab80-58b3bfcfda5c service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:55.278570 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 657/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:58.650944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97ab5-13d1-4af1-bede-14d00d5110a9 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:58.651487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97ab5-13d1-4af1-bede-14d00d5110a9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:58.651487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97ab5-13d1-4af1-bede-14d00d5110a9 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:58.652789 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 666/1323] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:58.657930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7facf02-0089-4b70-8a67-cb1e1c032ab1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:58.658369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7facf02-0089-4b70-8a67-cb1e1c032ab1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:58.658483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7facf02-0089-4b70-8a67-cb1e1c032ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:58.723969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a7facf02-0089-4b70-8a67-cb1e1c032ab1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:58.725384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a7facf02-0089-4b70-8a67-cb1e1c032ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:58.782824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:58.822609 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 658/1324] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:58.857981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97ab5-13d1-4af1-bede-14d00d5110a9 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:58.859530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8ed97ab5-13d1-4af1-bede-14d00d5110a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:58.964568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97ab5-13d1-4af1-bede-14d00d5110a9 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:58.977519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:59.040820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:59.041497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:59.041781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:59.042054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:59.043726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:59.155226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:59.156676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aac298-08a7-4d2c-8be5-cab450155c2e service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:59.176636 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 667/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:01.457222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7444d19-70d5-474b-8147-8e3dc5df5c7a None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.457829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7444d19-70d5-474b-8147-8e3dc5df5c7a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.457829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7444d19-70d5-474b-8147-8e3dc5df5c7a None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.459287 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 659/1326] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:01.465475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a039-9ec9-4129-bdc4-ee891465a095 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.465983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a039-9ec9-4129-bdc4-ee891465a095 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.466091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a039-9ec9-4129-bdc4-ee891465a095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.514123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:01.533188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e675a039-9ec9-4129-bdc4-ee891465a095 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:01.534409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e675a039-9ec9-4129-bdc4-ee891465a095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:01.637204 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 668/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:01.673085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7444d19-70d5-474b-8147-8e3dc5df5c7a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.674651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f7444d19-70d5-474b-8147-8e3dc5df5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:01.781538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7444d19-70d5-474b-8147-8e3dc5df5c7a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.858758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.859402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.859682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.859957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.861681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:01.878336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:01.973060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.974544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c1335-5989-4934-9b59-89bb2c00aca5 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.993009 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 660/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:04.278449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8057eaa-4cf3-4629-b605-6c7b9535ba1c None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:04.279019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8057eaa-4cf3-4629-b605-6c7b9535ba1c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:04.279118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8057eaa-4cf3-4629-b605-6c7b9535ba1c None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:04.280523 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 669/1329] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:04.285981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec805944-a386-4962-a50c-0e7096c40bf5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:04.286436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec805944-a386-4962-a50c-0e7096c40bf5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:04.286547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec805944-a386-4962-a50c-0e7096c40bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:04.353590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ec805944-a386-4962-a50c-0e7096c40bf5 None None] MFA Rules not processed for user `cf544868838942a889971356face3a45`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:04.354795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ec805944-a386-4962-a50c-0e7096c40bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:04.420571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:04.453409 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 661/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:04.491870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8057eaa-4cf3-4629-b605-6c7b9535ba1c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:04.493512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d8057eaa-4cf3-4629-b605-6c7b9535ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:04.599050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8057eaa-4cf3-4629-b605-6c7b9535ba1c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:04.619261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:04.673534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:04.674183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:04.674463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:04.674738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:04.676395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:04.785301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:04.786743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad4ac6-ea72-4b07-a84c-e1e5f4cb9791 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:04.805592 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 670/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:07.240668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a4f4f-1339-4c3d-b73d-54939675a452 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.241291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a4f4f-1339-4c3d-b73d-54939675a452 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.241797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a4f4f-1339-4c3d-b73d-54939675a452 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.244346 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 662/1332] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:07.248878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29562094-1e91-466f-9d0b-b0a04f39d4f3 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.249369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29562094-1e91-466f-9d0b-b0a04f39d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.249490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29562094-1e91-466f-9d0b-b0a04f39d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.312366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:07.315077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-29562094-1e91-466f-9d0b-b0a04f39d4f3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:07.316897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-29562094-1e91-466f-9d0b-b0a04f39d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.416057 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 671/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:07.452141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a4f4f-1339-4c3d-b73d-54939675a452 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.453788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f90a4f4f-1339-4c3d-b73d-54939675a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.562750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a4f4f-1339-4c3d-b73d-54939675a452 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:07.637702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:07.638351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.638645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.638918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.640577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.667327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:07.751664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.753124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9134cd-6d5e-439a-bf7b-47e7ca98241d service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.773030 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 663/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:10.052150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8ade-ec7c-47ff-9bae-c4f0ef4a375c None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.052697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8ade-ec7c-47ff-9bae-c4f0ef4a375c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.052697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8ade-ec7c-47ff-9bae-c4f0ef4a375c None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.054668 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 672/1335] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:10.059850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021741b0-02aa-4365-8b40-2465894d0990 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.060262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021741b0-02aa-4365-8b40-2465894d0990 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.060416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021741b0-02aa-4365-8b40-2465894d0990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.125695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-021741b0-02aa-4365-8b40-2465894d0990 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:10.126908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-021741b0-02aa-4365-8b40-2465894d0990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:10.200759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:10.223244 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 664/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:10.263847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8ade-ec7c-47ff-9bae-c4f0ef4a375c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:10.265413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f55a8ade-ec7c-47ff-9bae-c4f0ef4a375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:10.373665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8ade-ec7c-47ff-9bae-c4f0ef4a375c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:10.401691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:10.448308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:10.448945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.449255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.449656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.451294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:10.559605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:10.561051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71760513-ddca-4b6b-8878-43309ebe9adb service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:10.579046 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 673/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:13.202657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a494-b99b-402e-bee5-3f9595e32789 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.203191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a494-b99b-402e-bee5-3f9595e32789 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.203191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a494-b99b-402e-bee5-3f9595e32789 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.204507 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 665/1338] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:13.210190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d85d-3eba-458d-b21a-cb68be03ddda None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.210802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d85d-3eba-458d-b21a-cb68be03ddda None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.210802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d85d-3eba-458d-b21a-cb68be03ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.274975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-bce7d85d-3eba-458d-b21a-cb68be03ddda None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:13.276163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bce7d85d-3eba-458d-b21a-cb68be03ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:13.284351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:13.371860 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 674/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:13.407710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a494-b99b-402e-bee5-3f9595e32789 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:13.409293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3af2a494-b99b-402e-bee5-3f9595e32789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:13.511272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2a494-b99b-402e-bee5-3f9595e32789 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:13.586022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:13.586658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.586940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.587217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.588855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:13.625007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:13.700329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:13.701886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5576e-8ce5-42f8-b3e6-f62abb7d696c service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:13.720152 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 666/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:17.944248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad630a8a-c2df-46f3-9621-671f827487fb None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:17.944767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad630a8a-c2df-46f3-9621-671f827487fb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:17.944767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad630a8a-c2df-46f3-9621-671f827487fb None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:17.946194 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 675/1341] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:17.951449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f92ad-7ff0-4bbc-8ace-d1c1003b75b5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:17.951840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f92ad-7ff0-4bbc-8ace-d1c1003b75b5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:17.952008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f92ad-7ff0-4bbc-8ace-d1c1003b75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:18.028237 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a06f92ad-7ff0-4bbc-8ace-d1c1003b75b5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:18.029640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a06f92ad-7ff0-4bbc-8ace-d1c1003b75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:18.124932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:18.139578 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 667/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:18.178865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad630a8a-c2df-46f3-9621-671f827487fb None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:18.181308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ad630a8a-c2df-46f3-9621-671f827487fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:18.277917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad630a8a-c2df-46f3-9621-671f827487fb None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:18.281462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa19f-3daa-4348-9c2b-63c43f923144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:18.282105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa19f-3daa-4348-9c2b-63c43f923144 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:18.282382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa19f-3daa-4348-9c2b-63c43f923144 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:18.282661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa19f-3daa-4348-9c2b-63c43f923144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:18.292033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa19f-3daa-4348-9c2b-63c43f923144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:18.293499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa19f-3daa-4348-9c2b-63c43f923144 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:18.302808 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 676/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:21.101427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f439c-9cdf-47e0-98bd-e59ef68c2299 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:21.101958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f439c-9cdf-47e0-98bd-e59ef68c2299 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:21.101958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f439c-9cdf-47e0-98bd-e59ef68c2299 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:21.103266 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 668/1344] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:21.108400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110b4d-88f2-4697-bdb9-0ffa5ec1ea9f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:21.108856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110b4d-88f2-4697-bdb9-0ffa5ec1ea9f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:21.108964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110b4d-88f2-4697-bdb9-0ffa5ec1ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:21.136282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-32110b4d-88f2-4697-bdb9-0ffa5ec1ea9f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:21.137523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-32110b4d-88f2-4697-bdb9-0ffa5ec1ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:21.167413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:21.219104 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 677/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:21.256810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f439c-9cdf-47e0-98bd-e59ef68c2299 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:21.267370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f439c-9cdf-47e0-98bd-e59ef68c2299 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:21.270890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec337b7-836e-4367-b569-eb74636bac0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:21.271526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec337b7-836e-4367-b569-eb74636bac0f service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:21.271803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec337b7-836e-4367-b569-eb74636bac0f service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:21.272749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec337b7-836e-4367-b569-eb74636bac0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:21.281779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec337b7-836e-4367-b569-eb74636bac0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:21.283212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec337b7-836e-4367-b569-eb74636bac0f service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:21.293270 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 669/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:25.558162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee9f22-b133-4d87-8375-7f6874039536 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:25.558705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee9f22-b133-4d87-8375-7f6874039536 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:25.558705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee9f22-b133-4d87-8375-7f6874039536 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:25.559988 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 678/1347] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:25.565244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05595353-9797-4edd-859d-ce86eed205e5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:25.565643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05595353-9797-4edd-859d-ce86eed205e5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:25.565810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05595353-9797-4edd-859d-ce86eed205e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:25.584102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-05595353-9797-4edd-859d-ce86eed205e5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:25.585868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-05595353-9797-4edd-859d-ce86eed205e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:25.593927 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 670/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:25.631333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee9f22-b133-4d87-8375-7f6874039536 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:25.643270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee9f22-b133-4d87-8375-7f6874039536 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:25.647378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6db3d-9d97-4ec9-931e-d89b01b49541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:25.648381 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6db3d-9d97-4ec9-931e-d89b01b49541 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:25.648711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6db3d-9d97-4ec9-931e-d89b01b49541 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:25.649034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6db3d-9d97-4ec9-931e-d89b01b49541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:25.660138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6db3d-9d97-4ec9-931e-d89b01b49541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:25.661969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6db3d-9d97-4ec9-931e-d89b01b49541 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:25.672707 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 679/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:31.171500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bface-89fb-4d16-90ff-afeea7c672c5 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:31.172022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bface-89fb-4d16-90ff-afeea7c672c5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:31.172022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bface-89fb-4d16-90ff-afeea7c672c5 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:31.173643 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 671/1350] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:31.180362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4b44-d68b-4961-b27b-d4d965c61a64 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:31.181240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4b44-d68b-4961-b27b-d4d965c61a64 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:31.181734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4b44-d68b-4961-b27b-d4d965c61a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:31.267404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d2fc4b44-d68b-4961-b27b-d4d965c61a64 None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:31.268951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d2fc4b44-d68b-4961-b27b-d4d965c61a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:31.361608 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 680/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:35.563284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19819c-cd45-45eb-b629-c3f81637fd4b None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:35.563811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19819c-cd45-45eb-b629-c3f81637fd4b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:35.563924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19819c-cd45-45eb-b629-c3f81637fd4b None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:35.565426 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 672/1352] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:35.570866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8195-802a-4568-a9eb-40a2b1a0830f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:35.571699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8195-802a-4568-a9eb-40a2b1a0830f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:35.572218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8195-802a-4568-a9eb-40a2b1a0830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:35.578922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=13 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:35.591752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9c7c8195-802a-4568-a9eb-40a2b1a0830f None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:35.592885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9c7c8195-802a-4568-a9eb-40a2b1a0830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:35.602592 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 681/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:37.180280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152c89-ec57-497d-b519-ff1fcc27938a None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:37.180783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152c89-ec57-497d-b519-ff1fcc27938a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:37.180783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152c89-ec57-497d-b519-ff1fcc27938a None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:37.182370 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 673/1354] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:39:37.187050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4789-0832-451b-8449-1a05fed319b7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:37.187480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4789-0832-451b-8449-1a05fed319b7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:37.187614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4789-0832-451b-8449-1a05fed319b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:37.206517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-338c4789-0832-451b-8449-1a05fed319b7 None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:37.207714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-338c4789-0832-451b-8449-1a05fed319b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:37.217171 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 682/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:41.057195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0595-9728-4039-959b-50f1ce7742e3 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:41.057761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0595-9728-4039-959b-50f1ce7742e3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:41.057761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0595-9728-4039-959b-50f1ce7742e3 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:41.062898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 674/1356] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:41.064900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295dfb6-698b-4fc0-a853-010b71d73aeb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:41.065396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295dfb6-698b-4fc0-a853-010b71d73aeb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:41.065491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295dfb6-698b-4fc0-a853-010b71d73aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:41.090167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c295dfb6-698b-4fc0-a853-010b71d73aeb None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:41.091518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c295dfb6-698b-4fc0-a853-010b71d73aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:41.100081 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 683/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:41.154981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c6d3-1f60-4e79-bb30-8bbfb3aad3e7 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:41.155489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c6d3-1f60-4e79-bb30-8bbfb3aad3e7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:41.156062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c6d3-1f60-4e79-bb30-8bbfb3aad3e7 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:41.157898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 675/1358] 10.222.0.45 () {54 vars in 961 bytes} [Mon May 23 12:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:41.165793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3e83-ee82-45fb-af47-b08ba9844e81 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:41.166451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3e83-ee82-45fb-af47-b08ba9844e81 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:41.166934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b3e83-ee82-45fb-af47-b08ba9844e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:41.213833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:41.226794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d99b3e83-ee82-45fb-af47-b08ba9844e81 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:41.228338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d99b3e83-ee82-45fb-af47-b08ba9844e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:41.337045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c6d3-1f60-4e79-bb30-8bbfb3aad3e7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:41.337871 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 684/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Mon May 23 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:41.358424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c6d3-1f60-4e79-bb30-8bbfb3aad3e7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:41.364912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361b380-49c3-4abd-b4e3-8c9b85cb6fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:41.366325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361b380-49c3-4abd-b4e3-8c9b85cb6fc9 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:41.366789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361b380-49c3-4abd-b4e3-8c9b85cb6fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:41.367238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361b380-49c3-4abd-b4e3-8c9b85cb6fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:41.378244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361b380-49c3-4abd-b4e3-8c9b85cb6fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:41.380824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361b380-49c3-4abd-b4e3-8c9b85cb6fc9 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:41.395849 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 676/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:39:43.924654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00327-fd0a-4c57-a975-5aac93219b26 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:43.925232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00327-fd0a-4c57-a975-5aac93219b26 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:43.925446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00327-fd0a-4c57-a975-5aac93219b26 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:43.932845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba457cb2-26cb-4caf-8837-306162e30963 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:43.933859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba457cb2-26cb-4caf-8837-306162e30963 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:43.934971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba457cb2-26cb-4caf-8837-306162e30963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:43.936618 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 685/1361] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:43.957735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ba457cb2-26cb-4caf-8837-306162e30963 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:43.959038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ba457cb2-26cb-4caf-8837-306162e30963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:43.967852 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 677/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:44.016798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e00327-fd0a-4c57-a975-5aac93219b26 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:44.032995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e00327-fd0a-4c57-a975-5aac93219b26 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:44.039092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d49d1c-6593-4282-8d14-ad4d8aff9270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:44.039627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49d1c-6593-4282-8d14-ad4d8aff9270 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:44.039963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49d1c-6593-4282-8d14-ad4d8aff9270 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:44.040281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49d1c-6593-4282-8d14-ad4d8aff9270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:44.050640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d49d1c-6593-4282-8d14-ad4d8aff9270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:44.052363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d49d1c-6593-4282-8d14-ad4d8aff9270 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:44.065314 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 686/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:46.716798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114386f-df6b-4bda-a7af-2f5adfa4272a None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:46.717405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114386f-df6b-4bda-a7af-2f5adfa4272a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:46.717405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114386f-df6b-4bda-a7af-2f5adfa4272a None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:46.719028 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 678/1364] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:46.728394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9c73-e16c-4ed5-9389-d2dd8700b1d8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:46.729293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9c73-e16c-4ed5-9389-d2dd8700b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:46.729732 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9c73-e16c-4ed5-9389-d2dd8700b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:46.750855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d3dc9c73-e16c-4ed5-9389-d2dd8700b1d8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:46.752288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d3dc9c73-e16c-4ed5-9389-d2dd8700b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:46.761258 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 687/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:46.806642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98655-1019-4294-bf59-838680585f50 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:46.806953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98655-1019-4294-bf59-838680585f50 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:46.807234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98655-1019-4294-bf59-838680585f50 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:46.808604 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 679/1366] 10.222.0.45 () {54 vars in 961 bytes} [Mon May 23 12:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:46.813736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e95e9-9f28-4c6f-94b8-62e8cb50ae1c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:46.814022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e95e9-9f28-4c6f-94b8-62e8cb50ae1c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:46.814300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e95e9-9f28-4c6f-94b8-62e8cb50ae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:46.832402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d64e95e9-9f28-4c6f-94b8-62e8cb50ae1c None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:46.833625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d64e95e9-9f28-4c6f-94b8-62e8cb50ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:46.843384 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 688/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Mon May 23 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:46.852083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98655-1019-4294-bf59-838680585f50 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:46.868948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98655-1019-4294-bf59-838680585f50 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:46.874653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8155-35bc-4aa5-8a8a-c764aaa15dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:46.875301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8155-35bc-4aa5-8a8a-c764aaa15dcb service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:46.875591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8155-35bc-4aa5-8a8a-c764aaa15dcb service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:46.875872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8155-35bc-4aa5-8a8a-c764aaa15dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:46.884177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8155-35bc-4aa5-8a8a-c764aaa15dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:46.885799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8155-35bc-4aa5-8a8a-c764aaa15dcb service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:46.895737 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 680/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:49.202280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98babc40-fe95-48f1-9f1a-ecee6fb6e66f None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.203148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98babc40-fe95-48f1-9f1a-ecee6fb6e66f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.203430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98babc40-fe95-48f1-9f1a-ecee6fb6e66f None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.204814 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 689/1369] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:49.211155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1788-85ae-4a1e-b281-91afa0e2860f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.211635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1788-85ae-4a1e-b281-91afa0e2860f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.211729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1788-85ae-4a1e-b281-91afa0e2860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.230720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-dfda1788-85ae-4a1e-b281-91afa0e2860f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:49.231928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-dfda1788-85ae-4a1e-b281-91afa0e2860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:49.240026 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 681/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:49.284711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98babc40-fe95-48f1-9f1a-ecee6fb6e66f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:49.300508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98babc40-fe95-48f1-9f1a-ecee6fb6e66f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:49.307268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc56e2-0baf-4b52-a752-22e5a374fef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:49.307940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc56e2-0baf-4b52-a752-22e5a374fef7 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.308219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc56e2-0baf-4b52-a752-22e5a374fef7 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.308506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc56e2-0baf-4b52-a752-22e5a374fef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.318050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc56e2-0baf-4b52-a752-22e5a374fef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:49.320403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc56e2-0baf-4b52-a752-22e5a374fef7 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:49.335067 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 690/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:49.504322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548dc81-2786-44e9-b4dc-0c0a03ac828d None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.504949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548dc81-2786-44e9-b4dc-0c0a03ac828d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.505387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548dc81-2786-44e9-b4dc-0c0a03ac828d None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.508123 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 682/1372] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:49.513844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6565ed-afa8-49ea-a84e-4fb413526835 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.514249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6565ed-afa8-49ea-a84e-4fb413526835 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.514632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6565ed-afa8-49ea-a84e-4fb413526835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.536152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9b6565ed-afa8-49ea-a84e-4fb413526835 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:49.537937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9b6565ed-afa8-49ea-a84e-4fb413526835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:49.549189 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 691/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:49.877534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99114-83bc-4b24-96a5-ce77dbf8c132 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.877937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99114-83bc-4b24-96a5-ce77dbf8c132 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.878316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99114-83bc-4b24-96a5-ce77dbf8c132 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.879803 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 683/1374] 10.222.0.45 () {54 vars in 963 bytes} [Mon May 23 12:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:49.887248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f54365-4b4e-41c4-926a-517df436feef None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.887541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f54365-4b4e-41c4-926a-517df436feef None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.887818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f54365-4b4e-41c4-926a-517df436feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.939954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c1f54365-4b4e-41c4-926a-517df436feef None None] MFA Rules not processed for user `ae6a98bfbada4666852398c78efce936`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:49.941356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c1f54365-4b4e-41c4-926a-517df436feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:50.011155 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 692/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Mon May 23 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:50.018756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99114-83bc-4b24-96a5-ce77dbf8c132 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.030697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99114-83bc-4b24-96a5-ce77dbf8c132 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.034340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ba74-4952-42e1-a317-ed5f36e24d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.034975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ba74-4952-42e1-a317-ed5f36e24d45 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.035258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ba74-4952-42e1-a317-ed5f36e24d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.035553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ba74-4952-42e1-a317-ed5f36e24d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.046553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ba74-4952-42e1-a317-ed5f36e24d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.048111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ba74-4952-42e1-a317-ed5f36e24d45 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.065285 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 684/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:51.643584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d885d8-3087-4e0f-b49f-a31158a0551a None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.644166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d885d8-3087-4e0f-b49f-a31158a0551a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.644166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d885d8-3087-4e0f-b49f-a31158a0551a None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.645593 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 693/1377] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:51.652259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe9b3-a773-4905-8ae2-ae3f3f22abb8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.652842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe9b3-a773-4905-8ae2-ae3f3f22abb8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.652842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe9b3-a773-4905-8ae2-ae3f3f22abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.672907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-65abe9b3-a773-4905-8ae2-ae3f3f22abb8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:51.674213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-65abe9b3-a773-4905-8ae2-ae3f3f22abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.687259 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 685/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:51.732785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d885d8-3087-4e0f-b49f-a31158a0551a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.748181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d885d8-3087-4e0f-b49f-a31158a0551a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.753750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec8a5-27c4-4132-a60e-b7308b2d869a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.754424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec8a5-27c4-4132-a60e-b7308b2d869a service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.754708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec8a5-27c4-4132-a60e-b7308b2d869a service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.755008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec8a5-27c4-4132-a60e-b7308b2d869a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.764816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec8a5-27c4-4132-a60e-b7308b2d869a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.766494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec8a5-27c4-4132-a60e-b7308b2d869a service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.770838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:51.778512 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 694/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:54.072202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a549-dcd0-48c8-915a-f16ac33b123d None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.072794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a549-dcd0-48c8-915a-f16ac33b123d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.072794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a549-dcd0-48c8-915a-f16ac33b123d None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.074247 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 686/1380] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:54.079755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee681-7d0a-4d10-97f8-84c5591bb2e1 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.080192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee681-7d0a-4d10-97f8-84c5591bb2e1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.080312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee681-7d0a-4d10-97f8-84c5591bb2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.099057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a6eee681-7d0a-4d10-97f8-84c5591bb2e1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:54.100512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a6eee681-7d0a-4d10-97f8-84c5591bb2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.108902 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 695/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:54.154518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a549-dcd0-48c8-915a-f16ac33b123d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.169220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a549-dcd0-48c8-915a-f16ac33b123d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.174707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9c9c-648f-4de1-8920-fb94f0fa752c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.175378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9c9c-648f-4de1-8920-fb94f0fa752c service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.175660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9c9c-648f-4de1-8920-fb94f0fa752c service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.175942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9c9c-648f-4de1-8920-fb94f0fa752c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.185936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda9c9c-648f-4de1-8920-fb94f0fa752c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.187508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda9c9c-648f-4de1-8920-fb94f0fa752c service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.198577 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 687/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:56.452139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a490-e184-4665-8134-9a334febdc7c None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.452700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a490-e184-4665-8134-9a334febdc7c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.452700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a490-e184-4665-8134-9a334febdc7c None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.454134 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 696/1383] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:56.459800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae7d1-665d-454e-b3d2-075dbe026d9e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.460275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae7d1-665d-454e-b3d2-075dbe026d9e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.460481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae7d1-665d-454e-b3d2-075dbe026d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.479443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c41ae7d1-665d-454e-b3d2-075dbe026d9e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:56.480621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c41ae7d1-665d-454e-b3d2-075dbe026d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:56.488332 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 688/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:56.533470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a490-e184-4665-8134-9a334febdc7c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:56.549517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a490-e184-4665-8134-9a334febdc7c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:56.555435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee466ac0-2e22-4439-b07b-645e5f83032b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:56.556228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ac0-2e22-4439-b07b-645e5f83032b service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.556579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ac0-2e22-4439-b07b-645e5f83032b service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.556926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ac0-2e22-4439-b07b-645e5f83032b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.566657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ac0-2e22-4439-b07b-645e5f83032b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:56.568384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ac0-2e22-4439-b07b-645e5f83032b service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:56.579667 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 697/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:58.844165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ecde-495f-4544-b2bf-bd96adbee2da None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:58.844722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ecde-495f-4544-b2bf-bd96adbee2da None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:58.844722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ecde-495f-4544-b2bf-bd96adbee2da None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:58.846194 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 689/1386] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:39:58.852082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd240c9-c3a9-4d3f-9d53-27da92915d2b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:58.852778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd240c9-c3a9-4d3f-9d53-27da92915d2b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:58.852778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd240c9-c3a9-4d3f-9d53-27da92915d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:58.871350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6dd240c9-c3a9-4d3f-9d53-27da92915d2b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:58.872620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6dd240c9-c3a9-4d3f-9d53-27da92915d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:58.880820 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 698/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:58.933697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ecde-495f-4544-b2bf-bd96adbee2da None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:58.948620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ecde-495f-4544-b2bf-bd96adbee2da None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:58.954453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b881ef7-3da7-48aa-94dd-2230fc81268d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:58.955109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b881ef7-3da7-48aa-94dd-2230fc81268d service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:58.955396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b881ef7-3da7-48aa-94dd-2230fc81268d service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:58.955704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b881ef7-3da7-48aa-94dd-2230fc81268d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:58.964616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b881ef7-3da7-48aa-94dd-2230fc81268d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:58.966269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b881ef7-3da7-48aa-94dd-2230fc81268d service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:58.977132 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 690/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:02.190460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aca10-442c-4829-bae3-bf085cdcb56e None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:02.191030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aca10-442c-4829-bae3-bf085cdcb56e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:02.191160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aca10-442c-4829-bae3-bf085cdcb56e None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:02.192549 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 699/1389] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:02.199589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d0a3-e120-4763-b950-9e61365f62ce None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:02.200006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d0a3-e120-4763-b950-9e61365f62ce None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:02.200251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d0a3-e120-4763-b950-9e61365f62ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:02.219117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-20e7d0a3-e120-4763-b950-9e61365f62ce None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:02.220345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-20e7d0a3-e120-4763-b950-9e61365f62ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:02.228895 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 691/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:02.274494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aca10-442c-4829-bae3-bf085cdcb56e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:02.289329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aca10-442c-4829-bae3-bf085cdcb56e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:02.294990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a32f-4ea4-41ed-a56b-d7c396c1f9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:02.295640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a32f-4ea4-41ed-a56b-d7c396c1f9b1 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:02.295919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a32f-4ea4-41ed-a56b-d7c396c1f9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:02.296205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a32f-4ea4-41ed-a56b-d7c396c1f9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:02.305623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a32f-4ea4-41ed-a56b-d7c396c1f9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:02.307268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a32f-4ea4-41ed-a56b-d7c396c1f9b1 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:02.316994 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 700/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:04.722170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0085-4c08-4a5a-af16-00f89336923d None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:04.722832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0085-4c08-4a5a-af16-00f89336923d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:04.722832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0085-4c08-4a5a-af16-00f89336923d None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:04.724506 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 692/1392] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:04.730852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb94a9-9428-4260-8cdf-5a70b1a8bd50 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:04.731372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb94a9-9428-4260-8cdf-5a70b1a8bd50 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:04.731478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb94a9-9428-4260-8cdf-5a70b1a8bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:04.749822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9dcb94a9-9428-4260-8cdf-5a70b1a8bd50 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:04.751072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9dcb94a9-9428-4260-8cdf-5a70b1a8bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:04.759390 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 701/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:04.803995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0085-4c08-4a5a-af16-00f89336923d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:04.818427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0085-4c08-4a5a-af16-00f89336923d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:04.823848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f75446-cc10-4f90-926d-dbe33cde0505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:04.824492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f75446-cc10-4f90-926d-dbe33cde0505 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:04.824789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f75446-cc10-4f90-926d-dbe33cde0505 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:04.825064 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f75446-cc10-4f90-926d-dbe33cde0505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:04.833669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f75446-cc10-4f90-926d-dbe33cde0505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:04.835881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f75446-cc10-4f90-926d-dbe33cde0505 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:04.845525 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 693/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:06.669414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d2b2-f98e-4508-8557-4b8c951f6fca None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:06.669949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d2b2-f98e-4508-8557-4b8c951f6fca None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:06.669949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d2b2-f98e-4508-8557-4b8c951f6fca None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:06.671306 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 702/1395] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:06.677273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9fd3-d450-4be3-a5f9-1bd7ee6f6d1e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:06.677741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9fd3-d450-4be3-a5f9-1bd7ee6f6d1e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:06.677917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9fd3-d450-4be3-a5f9-1bd7ee6f6d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:06.685478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=52 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:06.700545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fe1a9fd3-d450-4be3-a5f9-1bd7ee6f6d1e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:06.701802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fe1a9fd3-d450-4be3-a5f9-1bd7ee6f6d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:06.709959 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 694/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:06.767695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c412d7-c10a-4b84-a0c1-b0580ed0ebc1 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:06.768008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c412d7-c10a-4b84-a0c1-b0580ed0ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:06.768286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c412d7-c10a-4b84-a0c1-b0580ed0ebc1 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:06.769675 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 703/1397] 10.222.0.45 () {54 vars in 962 bytes} [Mon May 23 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:06.774912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28dad-e4b8-4f0a-bcda-90c42fdfda57 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:06.775211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28dad-e4b8-4f0a-bcda-90c42fdfda57 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:06.775494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28dad-e4b8-4f0a-bcda-90c42fdfda57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:06.826829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3ec28dad-e4b8-4f0a-bcda-90c42fdfda57 None None] MFA Rules not processed for user `1f50c773fb0c4b1bb1da7133725f7d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:06.828041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3ec28dad-e4b8-4f0a-bcda-90c42fdfda57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:06.894439 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 695/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Mon May 23 12:40:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:06.903570 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c412d7-c10a-4b84-a0c1-b0580ed0ebc1 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:06.916169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c412d7-c10a-4b84-a0c1-b0580ed0ebc1 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:06.920609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a005-0f70-420a-8d1f-5168b0e0e9f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:06.921234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a005-0f70-420a-8d1f-5168b0e0e9f8 service glance] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:06.921524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a005-0f70-420a-8d1f-5168b0e0e9f8 service glance] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:06.921802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a005-0f70-420a-8d1f-5168b0e0e9f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:06.932591 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141a005-0f70-420a-8d1f-5168b0e0e9f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:06.934108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141a005-0f70-420a-8d1f-5168b0e0e9f8 service glance] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:06.944873 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 704/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:07.099337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796744e8-74b4-43ed-ab48-15b65b61529c None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.099633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796744e8-74b4-43ed-ab48-15b65b61529c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.099965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796744e8-74b4-43ed-ab48-15b65b61529c None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.101493 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 696/1400] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:07.106821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e1a56-3ec5-49a8-9ba0-7bfd1c1590a3 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.107106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e1a56-3ec5-49a8-9ba0-7bfd1c1590a3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.107382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e1a56-3ec5-49a8-9ba0-7bfd1c1590a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.125998 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-927e1a56-3ec5-49a8-9ba0-7bfd1c1590a3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:07.127231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-927e1a56-3ec5-49a8-9ba0-7bfd1c1590a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:07.136763 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 705/1401] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:07.182621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796744e8-74b4-43ed-ab48-15b65b61529c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:07.200847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796744e8-74b4-43ed-ab48-15b65b61529c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:07.211070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d05d1d-cb7a-430b-ae8c-6db086da8b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:07.211070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05d1d-cb7a-430b-ae8c-6db086da8b38 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.211070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05d1d-cb7a-430b-ae8c-6db086da8b38 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.211070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05d1d-cb7a-430b-ae8c-6db086da8b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.218948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d05d1d-cb7a-430b-ae8c-6db086da8b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:07.220553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d05d1d-cb7a-430b-ae8c-6db086da8b38 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:07.232075 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 697/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:07.505429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f5224-4291-4994-a876-35ff086f5bf8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.505725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f5224-4291-4994-a876-35ff086f5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.506597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f5224-4291-4994-a876-35ff086f5bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.556210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-024f5224-4291-4994-a876-35ff086f5bf8 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:07.557867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-024f5224-4291-4994-a876-35ff086f5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:07.625282 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 706/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:07.668238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d9cb-e6bb-488e-be56-5de9aa34578c None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.668536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d9cb-e6bb-488e-be56-5de9aa34578c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.668820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d9cb-e6bb-488e-be56-5de9aa34578c None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.670251 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 698/1404] 10.222.0.45 () {54 vars in 942 bytes} [Mon May 23 12:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:07.676913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12556d76-76ec-453b-9d90-680daa43c318 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.677436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12556d76-76ec-453b-9d90-680daa43c318 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.677772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12556d76-76ec-453b-9d90-680daa43c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.729324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-12556d76-76ec-453b-9d90-680daa43c318 None None] MFA Rules not processed for user `5a9ea8c8127b48c483bd5e06b641253f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:07.730537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-12556d76-76ec-453b-9d90-680daa43c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:07.766466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:07.805288 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 707/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Mon May 23 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:07.814580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d9cb-e6bb-488e-be56-5de9aa34578c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:07.828790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d9cb-e6bb-488e-be56-5de9aa34578c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:07.833788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb858-9b7b-42a4-bdcc-a7f9f4b24bb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:07.834517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb858-9b7b-42a4-bdcc-a7f9f4b24bb7 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:07.834802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb858-9b7b-42a4-bdcc-a7f9f4b24bb7 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:07.835081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb858-9b7b-42a4-bdcc-a7f9f4b24bb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:07.851236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eb858-9b7b-42a4-bdcc-a7f9f4b24bb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:07.852825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eb858-9b7b-42a4-bdcc-a7f9f4b24bb7 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:07.861278 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 699/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:40:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:40:09.586769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfaee6-1849-44c9-99ab-23fe9d634d69 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.587281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfaee6-1849-44c9-99ab-23fe9d634d69 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.587281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfaee6-1849-44c9-99ab-23fe9d634d69 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.588593 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 708/1407] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:40:09.593812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e286-7606-4cf1-ad85-8e8b9fc61151 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.594244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e286-7606-4cf1-ad85-8e8b9fc61151 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.594365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e286-7606-4cf1-ad85-8e8b9fc61151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.613411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f617e286-7606-4cf1-ad85-8e8b9fc61151 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:09.614885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f617e286-7606-4cf1-ad85-8e8b9fc61151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:09.625177 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 700/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:09.670371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfaee6-1849-44c9-99ab-23fe9d634d69 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.688241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfaee6-1849-44c9-99ab-23fe9d634d69 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.695168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2328f-3751-4bfb-9bf3-cb95cb182553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.695865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2328f-3751-4bfb-9bf3-cb95cb182553 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.696145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2328f-3751-4bfb-9bf3-cb95cb182553 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.696420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2328f-3751-4bfb-9bf3-cb95cb182553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.705439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2328f-3751-4bfb-9bf3-cb95cb182553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.707054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2328f-3751-4bfb-9bf3-cb95cb182553 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.717271 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 709/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:19.607852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=55 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:19.713229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=21 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:31.246412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decadeb7-6fc5-4b6e-b9d3-c04700b08c2c None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:31.254158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decadeb7-6fc5-4b6e-b9d3-c04700b08c2c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:31.254158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decadeb7-6fc5-4b6e-b9d3-c04700b08c2c None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:31.254158 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 701/1410] 10.222.0.45 () {54 vars in 918 bytes} [Mon May 23 12:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:31.254463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40c5e-8b9f-4ac8-a60a-93099142d821 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:31.254463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40c5e-8b9f-4ac8-a60a-93099142d821 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:31.254463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40c5e-8b9f-4ac8-a60a-93099142d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:31.272442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-78a40c5e-8b9f-4ac8-a60a-93099142d821 None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:31.273674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-78a40c5e-8b9f-4ac8-a60a-93099142d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:31.282522 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 710/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Mon May 23 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:31.297029 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452231d7-613b-487e-a417-b2ee7c4651e2 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:31.297356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452231d7-613b-487e-a417-b2ee7c4651e2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:31.297641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452231d7-613b-487e-a417-b2ee7c4651e2 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:31.299030 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 702/1412] 10.222.0.45 () {54 vars in 918 bytes} [Mon May 23 12:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:31.304119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e4995-3c2b-4bf5-b23b-6ef05bde42b1 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:31.304395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e4995-3c2b-4bf5-b23b-6ef05bde42b1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:31.304698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e4995-3c2b-4bf5-b23b-6ef05bde42b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:31.322281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-004e4995-3c2b-4bf5-b23b-6ef05bde42b1 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:31.323481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-004e4995-3c2b-4bf5-b23b-6ef05bde42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:31.334257 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 711/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Mon May 23 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:34.049735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c67b-9f0f-42b1-9c4d-86d6f1f90786 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:34.050339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c67b-9f0f-42b1-9c4d-86d6f1f90786 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:34.050339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c67b-9f0f-42b1-9c4d-86d6f1f90786 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:34.051686 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:34.057985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc7c7-ff7f-4aee-90d5-90b37dfb7738 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:34.058441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc7c7-ff7f-4aee-90d5-90b37dfb7738 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:34.058554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc7c7-ff7f-4aee-90d5-90b37dfb7738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:34.076648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e32cc7c7-ff7f-4aee-90d5-90b37dfb7738 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:34.078231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e32cc7c7-ff7f-4aee-90d5-90b37dfb7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:34.086452 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:34.129232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c67b-9f0f-42b1-9c4d-86d6f1f90786 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:34.144741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c67b-9f0f-42b1-9c4d-86d6f1f90786 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:34.150200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5fe17-56b1-4d5d-8299-267a99adb808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:34.150838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fe17-56b1-4d5d-8299-267a99adb808 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:34.151125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fe17-56b1-4d5d-8299-267a99adb808 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:34.151403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fe17-56b1-4d5d-8299-267a99adb808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:34.159487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5fe17-56b1-4d5d-8299-267a99adb808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:34.161056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5fe17-56b1-4d5d-8299-267a99adb808 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:34.171032 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 704/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:35.167709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd994-18db-414b-8a99-cf07781de61b None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:35.168236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd994-18db-414b-8a99-cf07781de61b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:35.168236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd994-18db-414b-8a99-cf07781de61b None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:35.169592 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:35.174466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9f878-a0a1-4a8a-b9bb-d8f5572fa5d2 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:35.174861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9f878-a0a1-4a8a-b9bb-d8f5572fa5d2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:35.175028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9f878-a0a1-4a8a-b9bb-d8f5572fa5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:35.192706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e9f9f878-a0a1-4a8a-b9bb-d8f5572fa5d2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:35.194467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e9f9f878-a0a1-4a8a-b9bb-d8f5572fa5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:35.202244 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:35.363343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd994-18db-414b-8a99-cf07781de61b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:35.378669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd994-18db-414b-8a99-cf07781de61b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:35.384688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25555a1-b33b-47ca-a42e-1c61f7747fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:35.385345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25555a1-b33b-47ca-a42e-1c61f7747fcf service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:35.385627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25555a1-b33b-47ca-a42e-1c61f7747fcf service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:35.385900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25555a1-b33b-47ca-a42e-1c61f7747fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:35.393961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25555a1-b33b-47ca-a42e-1c61f7747fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:35.395538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25555a1-b33b-47ca-a42e-1c61f7747fcf service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:35.405604 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 714/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:36.333218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd730d8c-ebdc-44d5-89e8-cd6955d34594 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:36.333625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd730d8c-ebdc-44d5-89e8-cd6955d34594 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:36.333787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd730d8c-ebdc-44d5-89e8-cd6955d34594 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:36.335822 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:36.341082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc78a1-edc0-4b00-a16d-d691b5f53cb6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:36.341514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc78a1-edc0-4b00-a16d-d691b5f53cb6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:36.341673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc78a1-edc0-4b00-a16d-d691b5f53cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:36.360422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b3bc78a1-edc0-4b00-a16d-d691b5f53cb6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:36.361665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b3bc78a1-edc0-4b00-a16d-d691b5f53cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:36.369532 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:36.518752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd730d8c-ebdc-44d5-89e8-cd6955d34594 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:36.533552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd730d8c-ebdc-44d5-89e8-cd6955d34594 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:36.538951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd713e6-fca6-4036-be1a-ed6311dac2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:36.539582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd713e6-fca6-4036-be1a-ed6311dac2e1 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:36.539868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd713e6-fca6-4036-be1a-ed6311dac2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:36.540147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd713e6-fca6-4036-be1a-ed6311dac2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:36.548220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd713e6-fca6-4036-be1a-ed6311dac2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:36.549829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd713e6-fca6-4036-be1a-ed6311dac2e1 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:36.559119 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 707/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:37.471570 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd23603-e1f0-448b-b8db-6c710257b927 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:37.472153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd23603-e1f0-448b-b8db-6c710257b927 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:37.472153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd23603-e1f0-448b-b8db-6c710257b927 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:37.473575 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:37.479397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f9599-6714-4a62-973e-49536d7e2a6a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:37.479812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f9599-6714-4a62-973e-49536d7e2a6a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:37.479957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f9599-6714-4a62-973e-49536d7e2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:37.497476 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b26f9599-6714-4a62-973e-49536d7e2a6a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:37.498693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b26f9599-6714-4a62-973e-49536d7e2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:37.506907 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:37.657452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd23603-e1f0-448b-b8db-6c710257b927 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:37.671724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd23603-e1f0-448b-b8db-6c710257b927 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:37.677421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91aa07-e0c2-4a78-af8d-0ae452086bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:37.678661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91aa07-e0c2-4a78-af8d-0ae452086bbd service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:37.678938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91aa07-e0c2-4a78-af8d-0ae452086bbd service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:37.679210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91aa07-e0c2-4a78-af8d-0ae452086bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:37.687665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91aa07-e0c2-4a78-af8d-0ae452086bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:37.689281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91aa07-e0c2-4a78-af8d-0ae452086bbd service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:37.699691 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 717/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:38.635407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4f77-b1f9-4703-8453-d8b2a45cfe39 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:38.635953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4f77-b1f9-4703-8453-d8b2a45cfe39 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:38.635953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4f77-b1f9-4703-8453-d8b2a45cfe39 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:38.637297 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:38.642188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f0459-2a23-4036-98f2-a055c7b9a0c0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:38.642589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f0459-2a23-4036-98f2-a055c7b9a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:38.642745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f0459-2a23-4036-98f2-a055c7b9a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:38.660685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8b7f0459-2a23-4036-98f2-a055c7b9a0c0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:38.661902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8b7f0459-2a23-4036-98f2-a055c7b9a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:38.670397 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:38.823272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4f77-b1f9-4703-8453-d8b2a45cfe39 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:38.837596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4f77-b1f9-4703-8453-d8b2a45cfe39 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:38.842921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98690-97b0-463a-acc6-11421c3aa222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:38.843552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98690-97b0-463a-acc6-11421c3aa222 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:38.843844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98690-97b0-463a-acc6-11421c3aa222 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:38.844122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98690-97b0-463a-acc6-11421c3aa222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:38.853085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98690-97b0-463a-acc6-11421c3aa222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:38.854700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98690-97b0-463a-acc6-11421c3aa222 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:38.863978 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 710/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:39.715922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087a62-e746-4d1c-90fa-aff533b79dfd None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:39.716498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087a62-e746-4d1c-90fa-aff533b79dfd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:39.716498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087a62-e746-4d1c-90fa-aff533b79dfd None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:39.717896 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:39.722800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970fdb5-ff02-4270-8200-aed98cb5598d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:39.723220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970fdb5-ff02-4270-8200-aed98cb5598d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:39.723362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970fdb5-ff02-4270-8200-aed98cb5598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:39.742687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e970fdb5-ff02-4270-8200-aed98cb5598d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:39.743870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e970fdb5-ff02-4270-8200-aed98cb5598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:39.751533 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:39.902722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1087a62-e746-4d1c-90fa-aff533b79dfd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:39.917665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1087a62-e746-4d1c-90fa-aff533b79dfd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:39.922966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd9517-644f-4cae-9e7e-adfc08187bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:39.923607 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9517-644f-4cae-9e7e-adfc08187bc7 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:39.923871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9517-644f-4cae-9e7e-adfc08187bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:39.924145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9517-644f-4cae-9e7e-adfc08187bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:39.932519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd9517-644f-4cae-9e7e-adfc08187bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:39.934120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd9517-644f-4cae-9e7e-adfc08187bc7 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:39.943751 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 720/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:40.799628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde045f4-56d0-4e5e-a034-1b9b9b0583aa None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:40.800141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde045f4-56d0-4e5e-a034-1b9b9b0583aa None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:40.800275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde045f4-56d0-4e5e-a034-1b9b9b0583aa None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:40.801629 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:40.807295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b35a-ea47-4339-9b3f-28437169a15d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:40.807727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b35a-ea47-4339-9b3f-28437169a15d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:40.807857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b35a-ea47-4339-9b3f-28437169a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:40.826661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-52f1b35a-ea47-4339-9b3f-28437169a15d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:40.827861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-52f1b35a-ea47-4339-9b3f-28437169a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:40.835588 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:40.985988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde045f4-56d0-4e5e-a034-1b9b9b0583aa None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:41.001334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde045f4-56d0-4e5e-a034-1b9b9b0583aa None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:41.006844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19183b6e-dda6-478e-8e32-9f1eaea0a2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:41.007482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19183b6e-dda6-478e-8e32-9f1eaea0a2b2 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:41.007767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19183b6e-dda6-478e-8e32-9f1eaea0a2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:41.008048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19183b6e-dda6-478e-8e32-9f1eaea0a2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:41.016091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19183b6e-dda6-478e-8e32-9f1eaea0a2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:41.017698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19183b6e-dda6-478e-8e32-9f1eaea0a2b2 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:41.027333 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 713/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:41.889845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50d3f-0dfb-40f9-8ce8-a4b321736228 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:41.890459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50d3f-0dfb-40f9-8ce8-a4b321736228 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:41.890459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50d3f-0dfb-40f9-8ce8-a4b321736228 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:41.891938 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:41.897532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f909c-ebf3-4b5d-94df-9fbe985532fe None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:41.897952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f909c-ebf3-4b5d-94df-9fbe985532fe None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:41.898093 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f909c-ebf3-4b5d-94df-9fbe985532fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:41.915947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-805f909c-ebf3-4b5d-94df-9fbe985532fe None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:41.917240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-805f909c-ebf3-4b5d-94df-9fbe985532fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:41.924819 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:42.077956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50d3f-0dfb-40f9-8ce8-a4b321736228 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:42.093446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50d3f-0dfb-40f9-8ce8-a4b321736228 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:42.099040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d58e8-f8e3-4a0c-adf8-91450d504eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:42.100238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d58e8-f8e3-4a0c-adf8-91450d504eca service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:42.100526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d58e8-f8e3-4a0c-adf8-91450d504eca service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:42.100795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d58e8-f8e3-4a0c-adf8-91450d504eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:42.108917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d58e8-f8e3-4a0c-adf8-91450d504eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:42.110540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d58e8-f8e3-4a0c-adf8-91450d504eca service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:42.119980 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 723/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:42.977176 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422f2b-627d-48fd-85af-7110090dd134 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:42.977734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422f2b-627d-48fd-85af-7110090dd134 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:42.977734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422f2b-627d-48fd-85af-7110090dd134 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:42.979182 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:42.984329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61705ee9-5d12-4f4b-92f1-9e339793996d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:42.984737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61705ee9-5d12-4f4b-92f1-9e339793996d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:42.984888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61705ee9-5d12-4f4b-92f1-9e339793996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.002548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-61705ee9-5d12-4f4b-92f1-9e339793996d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:43.003740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-61705ee9-5d12-4f4b-92f1-9e339793996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:43.011513 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:43.161818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422f2b-627d-48fd-85af-7110090dd134 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.176712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422f2b-627d-48fd-85af-7110090dd134 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.182200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d601-4288-4d55-adbd-037b709cc2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.182831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d601-4288-4d55-adbd-037b709cc2d1 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.183114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d601-4288-4d55-adbd-037b709cc2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.183392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d601-4288-4d55-adbd-037b709cc2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.191519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d601-4288-4d55-adbd-037b709cc2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.193088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d601-4288-4d55-adbd-037b709cc2d1 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.203094 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 716/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:45.307268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca0ba-88d3-47d2-bde6-5e4728c043d3 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:45.307842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca0ba-88d3-47d2-bde6-5e4728c043d3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:45.307842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca0ba-88d3-47d2-bde6-5e4728c043d3 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:45.309219 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:45.314574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189345d-a012-4383-bec6-1c860fe31b62 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:45.315014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189345d-a012-4383-bec6-1c860fe31b62 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:45.315122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189345d-a012-4383-bec6-1c860fe31b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:45.333268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9189345d-a012-4383-bec6-1c860fe31b62 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:45.334493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9189345d-a012-4383-bec6-1c860fe31b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:45.342346 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:45.381497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca0ba-88d3-47d2-bde6-5e4728c043d3 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:45.392093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca0ba-88d3-47d2-bde6-5e4728c043d3 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:45.395616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1583-a151-4aa1-be9d-ef5a138e69ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:45.396261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1583-a151-4aa1-be9d-ef5a138e69ed service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:45.396527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1583-a151-4aa1-be9d-ef5a138e69ed service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:45.396800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1583-a151-4aa1-be9d-ef5a138e69ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:45.405771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1583-a151-4aa1-be9d-ef5a138e69ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:45.407213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1583-a151-4aa1-be9d-ef5a138e69ed service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:45.417284 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 726/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:47.811781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316dec-9ef5-4e41-94d5-095421a8309f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:47.812332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316dec-9ef5-4e41-94d5-095421a8309f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:47.812332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316dec-9ef5-4e41-94d5-095421a8309f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:47.813752 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:47.819163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3b01-0996-4c9c-bbfc-2e29d551ba94 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:47.819613 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3b01-0996-4c9c-bbfc-2e29d551ba94 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:47.819732 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3b01-0996-4c9c-bbfc-2e29d551ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:47.837654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ac5d3b01-0996-4c9c-bbfc-2e29d551ba94 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:47.838982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ac5d3b01-0996-4c9c-bbfc-2e29d551ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:47.846826 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:47.885516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316dec-9ef5-4e41-94d5-095421a8309f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:47.896122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316dec-9ef5-4e41-94d5-095421a8309f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:47.899758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711eb60-64e2-4103-961b-ce8e4b9e0e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:47.900388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711eb60-64e2-4103-961b-ce8e4b9e0e4c service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:47.900673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711eb60-64e2-4103-961b-ce8e4b9e0e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:47.900949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711eb60-64e2-4103-961b-ce8e4b9e0e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:47.909770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711eb60-64e2-4103-961b-ce8e4b9e0e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:47.911183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711eb60-64e2-4103-961b-ce8e4b9e0e4c service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:47.921230 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 719/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:50.437520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352423-cc45-4987-a7ee-67603d85aa60 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:50.438078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352423-cc45-4987-a7ee-67603d85aa60 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:50.438078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352423-cc45-4987-a7ee-67603d85aa60 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:50.439423 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:50.445614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea32ff-2cb2-429a-b133-5f1fba6ef5c5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:50.446047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea32ff-2cb2-429a-b133-5f1fba6ef5c5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:50.446159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea32ff-2cb2-429a-b133-5f1fba6ef5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:50.463866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-cdea32ff-2cb2-429a-b133-5f1fba6ef5c5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:50.465129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cdea32ff-2cb2-429a-b133-5f1fba6ef5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:50.472955 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:50.512781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352423-cc45-4987-a7ee-67603d85aa60 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:50.514516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-00352423-cc45-4987-a7ee-67603d85aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:50.529338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352423-cc45-4987-a7ee-67603d85aa60 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:50.532879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ce15f-d5db-4da6-92d9-7e4947a3376c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:50.533667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce15f-d5db-4da6-92d9-7e4947a3376c service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:50.533952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce15f-d5db-4da6-92d9-7e4947a3376c service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:50.534230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce15f-d5db-4da6-92d9-7e4947a3376c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:50.543340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ce15f-d5db-4da6-92d9-7e4947a3376c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:50.544779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ce15f-d5db-4da6-92d9-7e4947a3376c service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:50.554949 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 729/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:52.951142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa4916-7a00-49d2-b90b-cd717fa851ad None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:52.951738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa4916-7a00-49d2-b90b-cd717fa851ad None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:52.951738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa4916-7a00-49d2-b90b-cd717fa851ad None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:52.953105 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:52.958450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79962a2-42fe-40bf-982d-bfa9eda5fadd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:52.959017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79962a2-42fe-40bf-982d-bfa9eda5fadd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:52.959297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79962a2-42fe-40bf-982d-bfa9eda5fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:52.977626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a79962a2-42fe-40bf-982d-bfa9eda5fadd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:52.978840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a79962a2-42fe-40bf-982d-bfa9eda5fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:52.986634 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:53.025905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa4916-7a00-49d2-b90b-cd717fa851ad None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:53.036561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa4916-7a00-49d2-b90b-cd717fa851ad None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:53.040818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbad5d8-fca8-47b6-addd-320e00293b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:53.041482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad5d8-fca8-47b6-addd-320e00293b2f service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:53.041833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad5d8-fca8-47b6-addd-320e00293b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:53.042114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad5d8-fca8-47b6-addd-320e00293b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:53.050975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbad5d8-fca8-47b6-addd-320e00293b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:53.053031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbad5d8-fca8-47b6-addd-320e00293b2f service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:53.062770 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 722/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:55.373646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad469ba-e716-4173-963b-b5be9d7b68e8 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:55.374179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad469ba-e716-4173-963b-b5be9d7b68e8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:55.374179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad469ba-e716-4173-963b-b5be9d7b68e8 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:55.375575 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:55.380910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676f0a5-91c0-4478-af88-808b49bca95f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:55.381349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676f0a5-91c0-4478-af88-808b49bca95f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:55.381593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676f0a5-91c0-4478-af88-808b49bca95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:55.399058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3676f0a5-91c0-4478-af88-808b49bca95f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:55.400265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3676f0a5-91c0-4478-af88-808b49bca95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:55.408085 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:55.446726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad469ba-e716-4173-963b-b5be9d7b68e8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:55.457364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad469ba-e716-4173-963b-b5be9d7b68e8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:55.461272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a81f-c763-4f6b-a04b-99923dba231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:55.461900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a81f-c763-4f6b-a04b-99923dba231b service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:55.462181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a81f-c763-4f6b-a04b-99923dba231b service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:55.462454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a81f-c763-4f6b-a04b-99923dba231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:55.471177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a81f-c763-4f6b-a04b-99923dba231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:55.472597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a81f-c763-4f6b-a04b-99923dba231b service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:55.482721 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 732/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:57.753770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96047dc3-6609-435d-9814-a47926456e78 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:57.754354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96047dc3-6609-435d-9814-a47926456e78 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:57.754354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96047dc3-6609-435d-9814-a47926456e78 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:57.755911 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:40:57.761202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0c446-1a01-406f-8e6b-0a7b3580ce28 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:57.761597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0c446-1a01-406f-8e6b-0a7b3580ce28 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:57.761749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0c446-1a01-406f-8e6b-0a7b3580ce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:57.779423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c3b0c446-1a01-406f-8e6b-0a7b3580ce28 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:57.780626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c3b0c446-1a01-406f-8e6b-0a7b3580ce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:57.789177 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:57.829089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96047dc3-6609-435d-9814-a47926456e78 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:57.840258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96047dc3-6609-435d-9814-a47926456e78 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:57.843737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35be024-30e9-4a7d-a0d3-5e29bfb1e980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:57.844369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be024-30e9-4a7d-a0d3-5e29bfb1e980 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:57.844657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be024-30e9-4a7d-a0d3-5e29bfb1e980 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:57.844936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be024-30e9-4a7d-a0d3-5e29bfb1e980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:57.855107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35be024-30e9-4a7d-a0d3-5e29bfb1e980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:57.856546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35be024-30e9-4a7d-a0d3-5e29bfb1e980 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:57.866001 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 725/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:00.133893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca901-d4b5-46e6-8123-c31ddb6cdf4c None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:00.134498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca901-d4b5-46e6-8123-c31ddb6cdf4c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:00.134498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca901-d4b5-46e6-8123-c31ddb6cdf4c None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:00.135809 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:00.141289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ee89c-79dd-4329-9089-ae54c710e44d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:00.141764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ee89c-79dd-4329-9089-ae54c710e44d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:00.141869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ee89c-79dd-4329-9089-ae54c710e44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:00.148391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=70 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:00.162496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8f7ee89c-79dd-4329-9089-ae54c710e44d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:00.163688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8f7ee89c-79dd-4329-9089-ae54c710e44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:00.171427 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:00.208174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca901-d4b5-46e6-8123-c31ddb6cdf4c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:00.214103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=73 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:00.220466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca901-d4b5-46e6-8123-c31ddb6cdf4c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:00.224824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c58e25-b363-4430-bc87-7c627f8dc7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:00.225501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58e25-b363-4430-bc87-7c627f8dc7ab service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:00.225784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58e25-b363-4430-bc87-7c627f8dc7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:00.226061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58e25-b363-4430-bc87-7c627f8dc7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:00.235249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c58e25-b363-4430-bc87-7c627f8dc7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:00.236734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c58e25-b363-4430-bc87-7c627f8dc7ab service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:00.246284 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 735/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:02.520186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3326-1e9e-4f7c-9e2a-5ce90c9e72e2 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:02.520751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3326-1e9e-4f7c-9e2a-5ce90c9e72e2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:02.520751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3326-1e9e-4f7c-9e2a-5ce90c9e72e2 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:02.522147 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:02.527359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec9e5f-f2ab-44e4-8a22-f9480532dd3e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:02.527817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec9e5f-f2ab-44e4-8a22-f9480532dd3e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:02.527916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec9e5f-f2ab-44e4-8a22-f9480532dd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:02.546190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-34ec9e5f-f2ab-44e4-8a22-f9480532dd3e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:02.547387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-34ec9e5f-f2ab-44e4-8a22-f9480532dd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:02.555781 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:02.592432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf3326-1e9e-4f7c-9e2a-5ce90c9e72e2 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:02.603274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf3326-1e9e-4f7c-9e2a-5ce90c9e72e2 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:02.606792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d26b-1a79-4efa-a4cd-150ab1828f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:02.607415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d26b-1a79-4efa-a4cd-150ab1828f27 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:02.607693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d26b-1a79-4efa-a4cd-150ab1828f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:02.607965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d26b-1a79-4efa-a4cd-150ab1828f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:02.617225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d26b-1a79-4efa-a4cd-150ab1828f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:02.618640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d26b-1a79-4efa-a4cd-150ab1828f27 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:02.627839 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 728/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:04.852580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7294-9d45-4d58-9cec-a1310e2b2e24 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:04.853168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7294-9d45-4d58-9cec-a1310e2b2e24 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:04.853168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7294-9d45-4d58-9cec-a1310e2b2e24 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:04.854542 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:04.860056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54aeb-3e0f-4af2-9f1e-282ae42c38dc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:04.860495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54aeb-3e0f-4af2-9f1e-282ae42c38dc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:04.860598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54aeb-3e0f-4af2-9f1e-282ae42c38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:04.879048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f6e54aeb-3e0f-4af2-9f1e-282ae42c38dc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:04.880284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f6e54aeb-3e0f-4af2-9f1e-282ae42c38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:04.888683 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:04.924879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7294-9d45-4d58-9cec-a1310e2b2e24 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:04.936734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7294-9d45-4d58-9cec-a1310e2b2e24 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:04.940207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c856-d0bb-4e03-8f3b-5af37523626c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:04.940831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c856-d0bb-4e03-8f3b-5af37523626c service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:04.941111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c856-d0bb-4e03-8f3b-5af37523626c service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:04.941418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c856-d0bb-4e03-8f3b-5af37523626c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:04.951394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c856-d0bb-4e03-8f3b-5af37523626c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:04.954145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c856-d0bb-4e03-8f3b-5af37523626c service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:04.970268 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 738/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:07.214119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4782a-ef4e-47ef-920a-6a9634a3ed8a None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:07.214707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4782a-ef4e-47ef-920a-6a9634a3ed8a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:07.214860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4782a-ef4e-47ef-920a-6a9634a3ed8a None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:07.216154 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:07.221525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8fed-5012-4dfd-9f0e-dce8749342d6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:07.221969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8fed-5012-4dfd-9f0e-dce8749342d6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:07.222118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8fed-5012-4dfd-9f0e-dce8749342d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:07.240112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9dfc8fed-5012-4dfd-9f0e-dce8749342d6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:07.241360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9dfc8fed-5012-4dfd-9f0e-dce8749342d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:07.249190 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:07.286097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4782a-ef4e-47ef-920a-6a9634a3ed8a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:07.297219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4782a-ef4e-47ef-920a-6a9634a3ed8a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:07.300718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016e18-21fb-4264-b397-7f0fe504183c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:07.301383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016e18-21fb-4264-b397-7f0fe504183c service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:07.301671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016e18-21fb-4264-b397-7f0fe504183c service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:07.301950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016e18-21fb-4264-b397-7f0fe504183c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:07.310931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b016e18-21fb-4264-b397-7f0fe504183c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:07.312341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b016e18-21fb-4264-b397-7f0fe504183c service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:07.322762 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 731/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:17.234865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=17 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:17.317520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=17 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:40.501890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7570d0-ee52-415e-a69d-ef43df8b30de None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:40.502493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7570d0-ee52-415e-a69d-ef43df8b30de None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:40.502493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7570d0-ee52-415e-a69d-ef43df8b30de None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:40.503878 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 740/1471] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:40.509801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3bdb5-9252-46f2-833e-cb3eaa09a871 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:40.510262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3bdb5-9252-46f2-833e-cb3eaa09a871 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:40.510367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3bdb5-9252-46f2-833e-cb3eaa09a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:40.528364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-dcb3bdb5-9252-46f2-833e-cb3eaa09a871 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:40.529605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-dcb3bdb5-9252-46f2-833e-cb3eaa09a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:40.537534 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 732/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:40.584634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ea85-456b-4857-909c-2854b7e8faa8 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:40.584866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ea85-456b-4857-909c-2854b7e8faa8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:40.585161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ea85-456b-4857-909c-2854b7e8faa8 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:40.586529 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 741/1473] 10.222.0.45 () {54 vars in 962 bytes} [Mon May 23 12:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:40.591193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92bd7-59b7-4c13-840b-008ad4a95e38 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:40.591492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92bd7-59b7-4c13-840b-008ad4a95e38 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:40.591776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92bd7-59b7-4c13-840b-008ad4a95e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:40.610232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-36f92bd7-59b7-4c13-840b-008ad4a95e38 None None] MFA Rules not processed for user `1f50c773fb0c4b1bb1da7133725f7d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:40.611421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-36f92bd7-59b7-4c13-840b-008ad4a95e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:40.618413 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 733/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Mon May 23 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:40.625347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ea85-456b-4857-909c-2854b7e8faa8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:40.636301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ea85-456b-4857-909c-2854b7e8faa8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:40.639712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b5abb-5f53-4d49-9426-a9cbc1e769a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:40.640332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b5abb-5f53-4d49-9426-a9cbc1e769a5 service glance] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:40.640612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b5abb-5f53-4d49-9426-a9cbc1e769a5 service glance] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:40.640887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b5abb-5f53-4d49-9426-a9cbc1e769a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:40.649761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b5abb-5f53-4d49-9426-a9cbc1e769a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:40.651194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b5abb-5f53-4d49-9426-a9cbc1e769a5 service glance] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:40.660519 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 742/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:42.961592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f09e-2c1a-4e38-b3e2-77684654910c None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:42.962154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f09e-2c1a-4e38-b3e2-77684654910c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:42.962154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f09e-2c1a-4e38-b3e2-77684654910c None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:42.963523 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 734/1476] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:42.968694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7bd9-24da-4898-8581-9ea50987d8e6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:42.969193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7bd9-24da-4898-8581-9ea50987d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:42.969293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7bd9-24da-4898-8581-9ea50987d8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:42.987529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e01e7bd9-24da-4898-8581-9ea50987d8e6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:42.988712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e01e7bd9-24da-4898-8581-9ea50987d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:42.997036 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 743/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:41:43.020514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f09e-2c1a-4e38-b3e2-77684654910c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:43.032797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f09e-2c1a-4e38-b3e2-77684654910c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:43.037281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:43.037920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:43.038203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:43.038477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:43.039321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:43.041063 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:41:43.041063 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:41:43.041063 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:41:43.042243 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c14149-a850-4158-b098-8c4c38bee407 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:43.061778 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 735/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Mon May 23 12:41:43 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:41:45.296073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6077-f1fb-4848-b1c6-333ca38378c7 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:45.296643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6077-f1fb-4848-b1c6-333ca38378c7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:45.296643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6077-f1fb-4848-b1c6-333ca38378c7 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:45.298040 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 744/1479] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:45.303920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecd9a5-f37c-4b27-b7c3-5eb7db3976cc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:45.304359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecd9a5-f37c-4b27-b7c3-5eb7db3976cc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:45.304491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecd9a5-f37c-4b27-b7c3-5eb7db3976cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:45.322812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a5ecd9a5-f37c-4b27-b7c3-5eb7db3976cc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:45.324009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a5ecd9a5-f37c-4b27-b7c3-5eb7db3976cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:45.331798 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 736/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:45.375638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6077-f1fb-4848-b1c6-333ca38378c7 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:45.390798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6077-f1fb-4848-b1c6-333ca38378c7 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:45.396338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf7575-cbbd-40ba-b1f6-70cc33bd5ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:45.396972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf7575-cbbd-40ba-b1f6-70cc33bd5ba3 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:45.397301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf7575-cbbd-40ba-b1f6-70cc33bd5ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:45.397580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf7575-cbbd-40ba-b1f6-70cc33bd5ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:45.405606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf7575-cbbd-40ba-b1f6-70cc33bd5ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:45.407199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf7575-cbbd-40ba-b1f6-70cc33bd5ba3 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:45.418682 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 745/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:47.850531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ea40-dd4e-4068-b98c-f147d2cafe22 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:47.851123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ea40-dd4e-4068-b98c-f147d2cafe22 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:47.851123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389ea40-dd4e-4068-b98c-f147d2cafe22 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:47.852465 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 737/1482] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:47.857691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb0fa-029f-4bec-975e-086722c8b29d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:47.858129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb0fa-029f-4bec-975e-086722c8b29d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:47.858268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb0fa-029f-4bec-975e-086722c8b29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:47.876553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-fc1cb0fa-029f-4bec-975e-086722c8b29d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:47.877795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-fc1cb0fa-029f-4bec-975e-086722c8b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:47.886061 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 746/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:47.922099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389ea40-dd4e-4068-b98c-f147d2cafe22 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:47.933530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389ea40-dd4e-4068-b98c-f147d2cafe22 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:47.936954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae05022-1735-4513-8b17-6c21f875333b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:47.937623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae05022-1735-4513-8b17-6c21f875333b service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:47.937908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae05022-1735-4513-8b17-6c21f875333b service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:47.938185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae05022-1735-4513-8b17-6c21f875333b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:47.947168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae05022-1735-4513-8b17-6c21f875333b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:47.948588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae05022-1735-4513-8b17-6c21f875333b service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:47.958027 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 738/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:50.244878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76194ea-9187-45b9-8906-86ac339f61ac None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:50.245486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76194ea-9187-45b9-8906-86ac339f61ac None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:50.245486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76194ea-9187-45b9-8906-86ac339f61ac None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:50.246829 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 747/1485] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:50.252073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21bbb-be2b-41b0-979f-ed4ad8909e90 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:50.252462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21bbb-be2b-41b0-979f-ed4ad8909e90 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:50.252644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21bbb-be2b-41b0-979f-ed4ad8909e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:50.270475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-09a21bbb-be2b-41b0-979f-ed4ad8909e90 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:50.271763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-09a21bbb-be2b-41b0-979f-ed4ad8909e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:50.280054 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 739/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:50.318126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76194ea-9187-45b9-8906-86ac339f61ac None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:50.328792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76194ea-9187-45b9-8906-86ac339f61ac None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:50.332349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a3150-b96c-4fdd-ad52-a1da8253627a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:50.333717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a3150-b96c-4fdd-ad52-a1da8253627a service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:50.334000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a3150-b96c-4fdd-ad52-a1da8253627a service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:50.334271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a3150-b96c-4fdd-ad52-a1da8253627a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:50.343753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a3150-b96c-4fdd-ad52-a1da8253627a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:50.345226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a3150-b96c-4fdd-ad52-a1da8253627a service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:50.355735 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 748/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:52.694652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cd647-c7a3-4528-9401-14b93dcdb335 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:52.695227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cd647-c7a3-4528-9401-14b93dcdb335 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:52.695326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cd647-c7a3-4528-9401-14b93dcdb335 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:52.697169 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 740/1488] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:52.702978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05bd4-5ae2-4932-989e-24935b3d7050 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:52.703456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05bd4-5ae2-4932-989e-24935b3d7050 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:52.703560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05bd4-5ae2-4932-989e-24935b3d7050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:52.720934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9ef05bd4-5ae2-4932-989e-24935b3d7050 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:52.722170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9ef05bd4-5ae2-4932-989e-24935b3d7050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:52.730180 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 749/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:52.770593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cd647-c7a3-4528-9401-14b93dcdb335 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:52.781353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cd647-c7a3-4528-9401-14b93dcdb335 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:52.784834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830767d8-7bc9-481a-88f8-d787fa52f1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:52.785522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830767d8-7bc9-481a-88f8-d787fa52f1ce service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:52.785829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830767d8-7bc9-481a-88f8-d787fa52f1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:52.786168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830767d8-7bc9-481a-88f8-d787fa52f1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:52.795247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830767d8-7bc9-481a-88f8-d787fa52f1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:52.796686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830767d8-7bc9-481a-88f8-d787fa52f1ce service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:52.806848 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 741/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:55.314924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d531a-208a-4d94-8b33-c7aee7d8955d None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:55.315512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d531a-208a-4d94-8b33-c7aee7d8955d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:55.315512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d531a-208a-4d94-8b33-c7aee7d8955d None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:55.316852 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 750/1491] 10.222.0.45 () {54 vars in 926 bytes} [Mon May 23 12:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:41:55.322803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce5995-f056-403b-a925-52b71af798e3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:55.323224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce5995-f056-403b-a925-52b71af798e3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:55.323362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce5995-f056-403b-a925-52b71af798e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:55.342894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2bce5995-f056-403b-a925-52b71af798e3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:55.344091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2bce5995-f056-403b-a925-52b71af798e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:55.352543 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 742/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Mon May 23 12:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:55.391445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d531a-208a-4d94-8b33-c7aee7d8955d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:55.402658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d531a-208a-4d94-8b33-c7aee7d8955d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:55.406134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b30d5-17e5-469c-9e21-78470f2391cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:55.406768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b30d5-17e5-469c-9e21-78470f2391cc service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:55.407047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b30d5-17e5-469c-9e21-78470f2391cc service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:55.407323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b30d5-17e5-469c-9e21-78470f2391cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:55.416087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b30d5-17e5-469c-9e21-78470f2391cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:55.417557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b30d5-17e5-469c-9e21-78470f2391cc service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:55.426916 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 751/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:05.336988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=33 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:05.422723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=33 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:36.072645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.073282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.073282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.091250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:43:36.092444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:36.100630 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 743/1494] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:43:36.109733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.110242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.110344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.129258 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:43:36.130457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:36.138423 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 752/1495] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:43:36.142817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.152652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f1aee-13a4-4d5a-b3bd-8584470861ac None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.157105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.157786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.158070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.158345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.159201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:43:36.159503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.160512 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.160512 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:43:36.160512 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:43:36.161424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.172923 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 744/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:43:36.182225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.192275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ddfc-6e50-4b20-bfbe-be142eb94451 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.196786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.197477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.197757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.198033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.198714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.200521 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.200521 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:43:36.200521 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:43:36.201771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.238993 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 753/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:43:36.243252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.254067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb7929-178d-427b-9825-2519b1a0c8e5 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.309537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.310208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.310497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.310779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.311481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.312497 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.312497 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:43:36.312497 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:43:36.313926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.335299 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 745/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:43:36.339414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.350133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e509d-6d45-4654-bddb-7833f603eedd admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.354803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.355505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.355799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.356079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.356813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.357880 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.357880 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:43:36.357880 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:43:36.358778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.372169 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 754/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:43:36.376380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.387091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f39c8-2665-4124-b040-0c4363e3e6dc admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.392339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.393001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.393391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.393678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.394469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.395485 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.395485 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:43:36.395485 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:43:36.396385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05f035-73a3-4056-a790-ac4fa2cfe305 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.410403 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 746/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:43:36.414510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.425176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528efa8-b6a3-4250-8090-d7b86ccb1cf4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.429827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.430696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.430978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.431255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] PATH_INFO: `/v3/projects/1f9ae3ab23c94967af9ff5570f89f58c/users/0bd5420f7f864dd08ea41bb84e00ff26/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.446094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9ae3ab23c94967af9ff5570f89f58c, user_id=0bd5420f7f864dd08ea41bb84e00ff26, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.447163 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.447163 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:43:36.447163 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:43:36.449109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986aaf3-2e79-4682-9f5b-ecd8bdc53d32 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.461860 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 755/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:43:36 2022] PUT /identity/v3/projects/1f9ae3ab23c94967af9ff5570f89f58c/users/0bd5420f7f864dd08ea41bb84e00ff26/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:43:36.473854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf41583-3dff-4baa-96a0-3209b8a0e6d5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.474235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf41583-3dff-4baa-96a0-3209b8a0e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.474532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf41583-3dff-4baa-96a0-3209b8a0e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.501819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fcf41583-3dff-4baa-96a0-3209b8a0e6d5 None None] MFA Rules not processed for user `0bd5420f7f864dd08ea41bb84e00ff26`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:43:36.503117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fcf41583-3dff-4baa-96a0-3209b8a0e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:36.567006 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 747/1502] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:43:36.580046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81323-bc41-43c9-958e-bf2523576b2a None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.580376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81323-bc41-43c9-958e-bf2523576b2a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.580653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81323-bc41-43c9-958e-bf2523576b2a None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.582233 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 756/1503] 10.222.0.45 () {54 vars in 963 bytes} [Mon May 23 12:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:43:36.587220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f457-52ec-4413-ad85-28c25d2366f6 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.587454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f457-52ec-4413-ad85-28c25d2366f6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.587733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f457-52ec-4413-ad85-28c25d2366f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.606198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9eb2f457-52ec-4413-ad85-28c25d2366f6 None None] MFA Rules not processed for user `ae6a98bfbada4666852398c78efce936`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:43:36.607395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9eb2f457-52ec-4413-ad85-28c25d2366f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:36.650718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:36.660025 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 748/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:43:36.667605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c81323-bc41-43c9-958e-bf2523576b2a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.678840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c81323-bc41-43c9-958e-bf2523576b2a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.682375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.683011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.683297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.683572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.692942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.694438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.703508 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 757/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:43:36.745728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1482aa-0303-4bb9-8c5c-bd68ef600134 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.746018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1482aa-0303-4bb9-8c5c-bd68ef600134 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.746298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1482aa-0303-4bb9-8c5c-bd68ef600134 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.747576 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 749/1506] 10.222.0.45 () {52 vars in 829 bytes} [Mon May 23 12:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:43:36.751076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:36.813906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd035b-bedb-469d-9f1f-d9a8b4e9fa17 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:36.818808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:36.819665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.819944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.820217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] PATH_INFO: `/v3/users/0bd5420f7f864dd08ea41bb84e00ff26` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.821404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd5420f7f864dd08ea41bb84e00ff26)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:36.822425 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:36.822425 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:43:36.822425 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:43:36.823634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:36.890631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd5420f7f864dd08ea41bb84e00ff26'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:36.903139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd5420f7f864dd08ea41bb84e00ff26'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:36.903938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd5420f7f864dd08ea41bb84e00ff26'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:36.913553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd5420f7f864dd08ea41bb84e00ff26'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:36.914198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd5420f7f864dd08ea41bb84e00ff26'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:36.932568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:36.942556 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 758/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:43:36 2022] DELETE /identity/v3/users/0bd5420f7f864dd08ea41bb84e00ff26 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:43:36.947015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:36.947300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:36.947577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:36.964713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:43:36.965997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:37.024496 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 750/1508] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:43:37.035369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:37.036817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:37.093789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54370e9-8197-4867-8735-f3bf07fb6935 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:37.098394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bfb6e-d9da-447f-ae93-bc59ce71ec9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:37.099044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bfb6e-d9da-447f-ae93-bc59ce71ec9b service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:37.099350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bfb6e-d9da-447f-ae93-bc59ce71ec9b service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:37.099626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bfb6e-d9da-447f-ae93-bc59ce71ec9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:37.108622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bfb6e-d9da-447f-ae93-bc59ce71ec9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:37.110091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bfb6e-d9da-447f-ae93-bc59ce71ec9b service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:37.120082 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 759/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:43:37.447075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:43:37.448204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:43:37.460677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3efb6-964f-4c78-acd7-9ba4e2cc7c9b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:43:37.466243 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:43:37.467448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:43:37.467744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:43:37.468022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] PATH_INFO: `/v3/projects/1f9ae3ab23c94967af9ff5570f89f58c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:43:37.469255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9ae3ab23c94967af9ff5570f89f58c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:43:37.472015 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:43:37.472015 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:43:37.472015 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:43:37.473532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:43:37.536224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9ae3ab23c94967af9ff5570f89f58c', 'request_id': 'req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:37.549820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9ae3ab23c94967af9ff5570f89f58c', 'request_id': 'req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:37.557888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9ae3ab23c94967af9ff5570f89f58c', 'request_id': 'req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:37.572564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] The token cache is being invalidate because project 1f9ae3ab23c94967af9ff5570f89f58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:43:37.572852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:37.573623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-57c3f1d9-78e8-4c6d-b026-d096b2c96ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:43:37.575214 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 751/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:43:37 2022] DELETE /identity/v3/projects/1f9ae3ab23c94967af9ff5570f89f58c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:43:47.115918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:43:47.569502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:31.603447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d5ec3-e979-46f6-bf1d-6ad1ac53fd3f None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:31.604088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d5ec3-e979-46f6-bf1d-6ad1ac53fd3f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:31.604088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d5ec3-e979-46f6-bf1d-6ad1ac53fd3f None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:31.605455 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:31.610250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80f12-b8a6-44b5-9878-57fab58e315e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:31.610684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80f12-b8a6-44b5-9878-57fab58e315e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:31.610842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80f12-b8a6-44b5-9878-57fab58e315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:31.630678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-70f80f12-b8a6-44b5-9878-57fab58e315e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:31.632019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-70f80f12-b8a6-44b5-9878-57fab58e315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:31.695518 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:31.775872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32052c-9690-4fbc-a5b3-bea00b6c00a5 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:31.776267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32052c-9690-4fbc-a5b3-bea00b6c00a5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:31.776610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32052c-9690-4fbc-a5b3-bea00b6c00a5 None None] PATH_INFO: `/v3` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:31.778023 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 761/1513] 10.222.0.55 () {54 vars in 925 bytes} [Mon May 23 12:45:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:45:31.790337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e968-9d87-41f3-ae24-0cf2615f946b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:31.790629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e968-9d87-41f3-ae24-0cf2615f946b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:31.790909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e968-9d87-41f3-ae24-0cf2615f946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:31.808719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-5096e968-9d87-41f3-ae24-0cf2615f946b None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:31.809955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5096e968-9d87-41f3-ae24-0cf2615f946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:31.869500 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32052c-9690-4fbc-a5b3-bea00b6c00a5 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:31.871234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ac32052c-9690-4fbc-a5b3-bea00b6c00a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:31.878373 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 753/1514] 10.222.0.55 () {58 vars in 1015 bytes} [Mon May 23 12:45:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:31.948101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32052c-9690-4fbc-a5b3-bea00b6c00a5 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:31.953483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa4db-73cd-4a32-b939-5ba7fc4b99af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:31.954128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa4db-73cd-4a32-b939-5ba7fc4b99af service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:31.954412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa4db-73cd-4a32-b939-5ba7fc4b99af service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:31.954696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa4db-73cd-4a32-b939-5ba7fc4b99af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:31.962895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afa4db-73cd-4a32-b939-5ba7fc4b99af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:31.964482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afa4db-73cd-4a32-b939-5ba7fc4b99af service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:31.974173 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 762/1515] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:45:32.863336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa859f-61d4-4e2a-af78-bda8b1f3b031 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:32.863884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa859f-61d4-4e2a-af78-bda8b1f3b031 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:32.863884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa859f-61d4-4e2a-af78-bda8b1f3b031 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:32.865337 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 754/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:32.870053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351f34-efef-45c1-b044-b71ff7dcc31c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:32.870501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351f34-efef-45c1-b044-b71ff7dcc31c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:32.870672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351f34-efef-45c1-b044-b71ff7dcc31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:32.896133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e0351f34-efef-45c1-b044-b71ff7dcc31c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:32.897979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e0351f34-efef-45c1-b044-b71ff7dcc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:32.905899 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 763/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:33.057954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa859f-61d4-4e2a-af78-bda8b1f3b031 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:33.071950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa859f-61d4-4e2a-af78-bda8b1f3b031 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:33.077387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb8e6e-021b-410b-a2f5-9321543bdf03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:33.078019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb8e6e-021b-410b-a2f5-9321543bdf03 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:33.078302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb8e6e-021b-410b-a2f5-9321543bdf03 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:33.078578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb8e6e-021b-410b-a2f5-9321543bdf03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:33.087243 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb8e6e-021b-410b-a2f5-9321543bdf03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:33.088838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb8e6e-021b-410b-a2f5-9321543bdf03 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:33.098444 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 755/1518] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:35.663807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ad43-da64-4f8f-b32b-b482c9cb5f1a None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:35.664392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ad43-da64-4f8f-b32b-b482c9cb5f1a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:35.664740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ad43-da64-4f8f-b32b-b482c9cb5f1a None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:35.666222 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 764/1519] 10.222.0.45 () {54 vars in 960 bytes} [Mon May 23 12:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:35.671214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e923e53-0fbb-455e-bef0-da95bb26badc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:35.671657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e923e53-0fbb-455e-bef0-da95bb26badc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:35.671793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e923e53-0fbb-455e-bef0-da95bb26badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:35.691949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3e923e53-0fbb-455e-bef0-da95bb26badc None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:35.693192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3e923e53-0fbb-455e-bef0-da95bb26badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:35.701733 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 756/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Mon May 23 12:45:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:35.709306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ad43-da64-4f8f-b32b-b482c9cb5f1a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:35.722964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ad43-da64-4f8f-b32b-b482c9cb5f1a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:35.728646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bac62f-29f2-402b-9cdb-0d6eb6b18e11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:35.729299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bac62f-29f2-402b-9cdb-0d6eb6b18e11 service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:35.729582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bac62f-29f2-402b-9cdb-0d6eb6b18e11 service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:35.729857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bac62f-29f2-402b-9cdb-0d6eb6b18e11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:35.738107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bac62f-29f2-402b-9cdb-0d6eb6b18e11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:35.739718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bac62f-29f2-402b-9cdb-0d6eb6b18e11 service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:35.750174 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 765/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:44.357678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c296c-b43c-47f0-8af0-1e8442bfa224 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:44.358150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c296c-b43c-47f0-8af0-1e8442bfa224 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:44.358263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c296c-b43c-47f0-8af0-1e8442bfa224 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:44.359650 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:44.364526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2aaf-15d4-452b-b4d1-42cd2b96e85d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:44.364934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2aaf-15d4-452b-b4d1-42cd2b96e85d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:44.365089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2aaf-15d4-452b-b4d1-42cd2b96e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:44.383080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-699f2aaf-15d4-452b-b4d1-42cd2b96e85d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:44.384294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-699f2aaf-15d4-452b-b4d1-42cd2b96e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:44.392052 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:44.544896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c296c-b43c-47f0-8af0-1e8442bfa224 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:44.558977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c296c-b43c-47f0-8af0-1e8442bfa224 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:44.564320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810b1ea-8334-4624-a8d4-6c63ee3f2cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:44.564956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b1ea-8334-4624-a8d4-6c63ee3f2cae service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:44.565274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b1ea-8334-4624-a8d4-6c63ee3f2cae service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:44.565554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b1ea-8334-4624-a8d4-6c63ee3f2cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:44.574294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810b1ea-8334-4624-a8d4-6c63ee3f2cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:44.575868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810b1ea-8334-4624-a8d4-6c63ee3f2cae service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:44.586819 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 758/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:45.462987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85e85-60af-4f4b-935e-6d10a7f7a023 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:45.463550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85e85-60af-4f4b-935e-6d10a7f7a023 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:45.463550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85e85-60af-4f4b-935e-6d10a7f7a023 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:45.464951 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:45.470024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a35ca-4495-4a60-b5a2-cf1e46c093bc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:45.470451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a35ca-4495-4a60-b5a2-cf1e46c093bc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:45.470586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a35ca-4495-4a60-b5a2-cf1e46c093bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:45.489302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f87a35ca-4495-4a60-b5a2-cf1e46c093bc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:45.490506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f87a35ca-4495-4a60-b5a2-cf1e46c093bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:45.498904 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:45.650325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85e85-60af-4f4b-935e-6d10a7f7a023 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:45.665505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85e85-60af-4f4b-935e-6d10a7f7a023 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:45.670872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33abe-a042-472d-a49d-378961b511e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:45.671533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33abe-a042-472d-a49d-378961b511e0 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:45.671819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33abe-a042-472d-a49d-378961b511e0 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:45.672104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33abe-a042-472d-a49d-378961b511e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:45.680625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33abe-a042-472d-a49d-378961b511e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:45.682250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33abe-a042-472d-a49d-378961b511e0 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:45.691900 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 768/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:50.019627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a613-38fe-40a5-b46a-6d2411dffa9b None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:50.020161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a613-38fe-40a5-b46a-6d2411dffa9b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:50.020161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a613-38fe-40a5-b46a-6d2411dffa9b None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:50.021585 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:50.027708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d4da7-897a-44bf-886f-bf57b67e5257 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:50.028122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d4da7-897a-44bf-886f-bf57b67e5257 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:50.028267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d4da7-897a-44bf-886f-bf57b67e5257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:50.046034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-862d4da7-897a-44bf-886f-bf57b67e5257 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:50.047235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-862d4da7-897a-44bf-886f-bf57b67e5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:50.055446 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:50.092075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a613-38fe-40a5-b46a-6d2411dffa9b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:50.093810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f309a613-38fe-40a5-b46a-6d2411dffa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:50.153474 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a613-38fe-40a5-b46a-6d2411dffa9b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:50.156937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d213b-4c9e-48bd-b19e-e8354f80aee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:50.157607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d213b-4c9e-48bd-b19e-e8354f80aee2 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:50.157891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d213b-4c9e-48bd-b19e-e8354f80aee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:50.158169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d213b-4c9e-48bd-b19e-e8354f80aee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:50.167090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d213b-4c9e-48bd-b19e-e8354f80aee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:50.168498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d213b-4c9e-48bd-b19e-e8354f80aee2 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:50.173307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:50.179782 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 761/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:52.373308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2ff8-eedb-452b-b097-07ce3c2922aa None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:52.373923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2ff8-eedb-452b-b097-07ce3c2922aa None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:52.373923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2ff8-eedb-452b-b097-07ce3c2922aa None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:52.375244 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:52.380757 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc778-0865-4bbd-9229-3495255bd3e7 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:52.381252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc778-0865-4bbd-9229-3495255bd3e7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:52.381507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc778-0865-4bbd-9229-3495255bd3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:52.399994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a2fcc778-0865-4bbd-9229-3495255bd3e7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:52.401352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a2fcc778-0865-4bbd-9229-3495255bd3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:52.409241 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:52.448147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2ff8-eedb-452b-b097-07ce3c2922aa None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:52.458987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2ff8-eedb-452b-b097-07ce3c2922aa None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:52.463193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b22f2-9e46-4b75-bb08-10fc49ac3b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:52.463829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b22f2-9e46-4b75-bb08-10fc49ac3b23 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:52.464114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b22f2-9e46-4b75-bb08-10fc49ac3b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:52.464391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b22f2-9e46-4b75-bb08-10fc49ac3b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:52.473775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b22f2-9e46-4b75-bb08-10fc49ac3b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:52.475940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b22f2-9e46-4b75-bb08-10fc49ac3b23 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:52.485524 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 771/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:56.327105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0204f2-5011-483b-8a86-07bb5dc29656 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:56.327661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0204f2-5011-483b-8a86-07bb5dc29656 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:56.327661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0204f2-5011-483b-8a86-07bb5dc29656 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:56.329065 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:56.334503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3198b-414c-47ac-aaa8-78f387f6f336 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:56.335117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3198b-414c-47ac-aaa8-78f387f6f336 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:56.335117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3198b-414c-47ac-aaa8-78f387f6f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:56.353367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-06d3198b-414c-47ac-aaa8-78f387f6f336 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:56.354553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-06d3198b-414c-47ac-aaa8-78f387f6f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:56.362356 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:56.641534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0204f2-5011-483b-8a86-07bb5dc29656 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:56.643385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ce0204f2-5011-483b-8a86-07bb5dc29656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:56.700672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0204f2-5011-483b-8a86-07bb5dc29656 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:56.704199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9521c6-b5fb-477c-a7c9-24d93007e8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:56.704837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9521c6-b5fb-477c-a7c9-24d93007e8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:56.705123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9521c6-b5fb-477c-a7c9-24d93007e8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:56.705432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9521c6-b5fb-477c-a7c9-24d93007e8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:56.714249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9521c6-b5fb-477c-a7c9-24d93007e8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:56.715667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9521c6-b5fb-477c-a7c9-24d93007e8b2 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:56.725198 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 764/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:45:58.958240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa695-1c47-4121-b5cd-b23e108fb948 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:58.958703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa695-1c47-4121-b5cd-b23e108fb948 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:58.958807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa695-1c47-4121-b5cd-b23e108fb948 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:58.960255 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:45:58.965496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82569da-f030-4be2-850b-43590c3c7e02 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:58.965951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82569da-f030-4be2-850b-43590c3c7e02 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:58.966059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82569da-f030-4be2-850b-43590c3c7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:58.984612 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a82569da-f030-4be2-850b-43590c3c7e02 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:45:58.985841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a82569da-f030-4be2-850b-43590c3c7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:58.994441 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:45:59.267193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa695-1c47-4121-b5cd-b23e108fb948 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:45:59.268900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d10fa695-1c47-4121-b5cd-b23e108fb948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:45:59.276990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=65 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:59.283336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa695-1c47-4121-b5cd-b23e108fb948 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:45:59.286862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fbda-b018-4f2f-8580-11e4d463fc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:45:59.287499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fbda-b018-4f2f-8580-11e4d463fc0b service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:45:59.287812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fbda-b018-4f2f-8580-11e4d463fc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:45:59.288103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fbda-b018-4f2f-8580-11e4d463fc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:45:59.297093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fbda-b018-4f2f-8580-11e4d463fc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:45:59.298567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fbda-b018-4f2f-8580-11e4d463fc0b service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:45:59.308486 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 774/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:46:08.979371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=32 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:46:09.304844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:35.429122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.430326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.430856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.456515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.458137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.468050 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 766/1540] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.478791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508ac1-38fa-4d6c-bac2-86d6b3409a4d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.479759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508ac1-38fa-4d6c-bac2-86d6b3409a4d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.480262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508ac1-38fa-4d6c-bac2-86d6b3409a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.504753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1b508ac1-38fa-4d6c-bac2-86d6b3409a4d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.506345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1b508ac1-38fa-4d6c-bac2-86d6b3409a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.519572 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 775/1541] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.524448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:35.538731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad6d6c-a59c-44c7-a9c6-744aa70787e0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:35.544058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:35.545061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.545594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.546099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.547171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:35.547847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:35.549969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceebb24-5920-4997-8330-602c92961e4f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:35.562387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.563019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.563522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.588690 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 767/1542] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:35.591762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b66bdb-a8d1-463b-bf74-84ee448c95bf None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.595408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b66bdb-a8d1-463b-bf74-84ee448c95bf None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.595936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b66bdb-a8d1-463b-bf74-84ee448c95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.599053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.600557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.618031 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 776/1543] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:35.619362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:35.630073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f3b66bdb-a8d1-463b-bf74-84ee448c95bf None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.631127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeb148-17f4-44f3-87a7-3e097f97e17b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:35.631262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f3b66bdb-a8d1-463b-bf74-84ee448c95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.644874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5107-5c97-4b8a-82a3-dbe897aba553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:35.646275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5107-5c97-4b8a-82a3-dbe897aba553 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.646556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5107-5c97-4b8a-82a3-dbe897aba553 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.646832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5107-5c97-4b8a-82a3-dbe897aba553 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.648750 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 768/1544] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.650068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6a47-f7c8-4f84-8dda-88dd7b1bf795 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.650357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6a47-f7c8-4f84-8dda-88dd7b1bf795 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.650636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6a47-f7c8-4f84-8dda-88dd7b1bf795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.652425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5107-5c97-4b8a-82a3-dbe897aba553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:35.655245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5107-5c97-4b8a-82a3-dbe897aba553 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:35.678715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-082f6a47-f7c8-4f84-8dda-88dd7b1bf795 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.680428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-082f6a47-f7c8-4f84-8dda-88dd7b1bf795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.689271 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 769/1545] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.691057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df24430-7e40-40a7-bdcc-75ab23e61fb8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.691798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df24430-7e40-40a7-bdcc-75ab23e61fb8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.692260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df24430-7e40-40a7-bdcc-75ab23e61fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.710608 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 777/1546] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:35.711956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913618c-49b4-4c4a-b2e1-116b2ae5920b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.712249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913618c-49b4-4c4a-b2e1-116b2ae5920b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.712532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913618c-49b4-4c4a-b2e1-116b2ae5920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.725716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-6df24430-7e40-40a7-bdcc-75ab23e61fb8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.727017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6df24430-7e40-40a7-bdcc-75ab23e61fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.741472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0913618c-49b4-4c4a-b2e1-116b2ae5920b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.743264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0913618c-49b4-4c4a-b2e1-116b2ae5920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.803298 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 770/1547] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.804857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0d018-a47a-4931-80f1-cffc40020a7d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.805174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0d018-a47a-4931-80f1-cffc40020a7d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.805662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0d018-a47a-4931-80f1-cffc40020a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.826987 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 778/1548] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.828713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.829257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.829748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.832535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-7ec0d018-a47a-4931-80f1-cffc40020a7d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.833788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7ec0d018-a47a-4931-80f1-cffc40020a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.843093 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 771/1549] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.844188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37bf0f-364d-432d-a1ec-5ddaf555b9d0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.845381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37bf0f-364d-432d-a1ec-5ddaf555b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.845673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37bf0f-364d-432d-a1ec-5ddaf555b9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.850979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.852431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.861538 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 779/1550] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.862582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:35.870696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ce37bf0f-364d-432d-a1ec-5ddaf555b9d0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.873094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08e0b3-6098-4200-9abd-887cd67163cd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:35.876093 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ce37bf0f-364d-432d-a1ec-5ddaf555b9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.878177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:35.879071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.879524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.879978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.880935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:35.882166 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:47:35.882166 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:47:35.882166 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:47:35.883723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5630c70-4e45-4d34-be3b-69d64f7f0025 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:35.884496 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 772/1551] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.887221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.887221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.887221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.907845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.909396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.913243 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 780/1552] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:35.917438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.917734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.918028 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 773/1553] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.918230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.920054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:35.929971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985314b-87fa-457d-a03d-ec1ffae7eaa5 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:35.934939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:35.935589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.935874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.936152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.936871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:35.937213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:35.937358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.938463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.938822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9200d-d85b-4f58-be7c-c8dd4502c780 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:35.946478 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 781/1554] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.947265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:35.952898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 774/1555] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:35.954951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e20bb-9e9e-427d-b18f-8e099f21a60d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.955250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e20bb-9e9e-427d-b18f-8e099f21a60d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.955537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e20bb-9e9e-427d-b18f-8e099f21a60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.956913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7f4a-1848-4e3a-ae55-518bc56139f7 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:35.961593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:35.962247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.962527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.962805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.963530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:35.963842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:35.964867 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:47:35.964867 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:47:35.964867 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:47:35.966588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:35.974786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-287e20bb-9e9e-427d-b18f-8e099f21a60d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:35.975996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-287e20bb-9e9e-427d-b18f-8e099f21a60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:35.979137 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 782/1556] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:35.980076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:35.988808 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 775/1557] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:35.988808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:35.988808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:35.988808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:35.995478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a854-ac8f-4bed-9c0c-416410300ebe admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.000118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.000764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.001176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.001440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.002452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:36.002758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.004349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.005006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:36.006226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:36.015237 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 776/1558] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:36.016044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.019453 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 783/1559] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:36.020752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.026358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca2dc-bfb9-456d-be40-cbddc62d0669 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.031735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd40f9-f6f6-465b-8387-a75e23d6b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.032427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd40f9-f6f6-465b-8387-a75e23d6b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.032740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ee08d-e727-4b8c-8302-5e0471353fef admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.032899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd40f9-f6f6-465b-8387-a75e23d6b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.033159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd40f9-f6f6-465b-8387-a75e23d6b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.033897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd40f9-f6f6-465b-8387-a75e23d6b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.035527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd40f9-f6f6-465b-8387-a75e23d6b4e4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.037536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.038215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.038506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.038780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.039497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:36.039807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.041440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.049131 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 777/1560] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.049131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.049131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.049131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.053521 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 784/1561] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:36.054242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.065826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bec1e-3e1f-4b92-8aa6-06a58bfeab94 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.070462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.070737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:36.071110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.071392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.071671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.071943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:36.072357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.074302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.080680 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 778/1562] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:36.081576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.092138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8306-3f71-4692-a9c2-c2c43664b2d8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.098407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.099357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.099642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.100080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.100721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.101792 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:47:36.101792 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:47:36.101792 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:47:36.102707 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 785/1563] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.103551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.105719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc28715-ed1d-4d61-91f3-33ee171a98a2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.135357 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 779/1564] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.137506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.137950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.138228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.139648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:36.156991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:36.158231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:36.170858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418083c-6e0f-4528-b7ba-06e81250a121 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.198356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:36.220048 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 780/1565] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:36.220880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.229878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be221b-f8e7-49cc-acde-803e3ab1399b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.233052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.233750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.234037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.234310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.235029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:36.235342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.235460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.236085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.236372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.236678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.236987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.237396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.239734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.249672 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 786/1566] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:36.250349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.261071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d7f61-c626-4cc1-9f1a-6a8ce0a5d616 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.265956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.266619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.266901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.267125 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 781/1567] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.267259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.267889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.268059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.269761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.283137 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 787/1568] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.284057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.295102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691810-e3d7-4d81-8fa8-d827d645633e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.337517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d61d-592d-4f75-bdf7-60a36fb06621 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.342680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.343351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.343643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.343927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.344887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.346861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.358986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.359583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.359868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.360153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.361006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:36.361354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.362959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.378008 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 782/1569] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.378008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.378315 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 788/1570] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:36.378315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.387950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433a6b3-91a8-4ed7-9101-9ae0c2b77f91 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.441322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:36.442275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d88c-fa75-4205-857a-817424a54cf4 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.447318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.447994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.448147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.448275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.448545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.448768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.449048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.449265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.449384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.450166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.451227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.452020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.479284 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 783/1571] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.479509 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 789/1572] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.479996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.480110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.485466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6686b-d994-4c23-ac54-19588eb0e1bd admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.490464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.490630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed82d8-1bba-4d9e-82f4-77c03cde6264 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.491113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.491394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.491670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.492384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:36.492692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.494304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.495370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.496004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.496296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.496915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.497280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.499173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.507503 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 784/1573] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:36.508277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.518683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566ab7-4e0c-4222-a315-2c2fbe0aabb2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.523490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.524152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.524438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.524714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.525452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.530129 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 790/1574] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.530129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.530395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.553966 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 785/1575] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.553966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.560877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:36.565030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f0af-0d61-4de0-821e-7310171682a9 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.591232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a83941-1618-46c4-8b3e-b9a56ccee786 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.596248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.597134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.597438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.597712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] PATH_INFO: `/v3/projects/e5d4c3ce33db4711835456d22e7bfdbb/users/ba74f13f2a1e445dab34258d50ec8012/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.613205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d4c3ce33db4711835456d22e7bfdbb, user_id=ba74f13f2a1e445dab34258d50ec8012, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.615805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.626582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.627256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.627539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.627821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.628507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.629465 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 791/1576] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:36 2022] PUT /identity/v3/projects/e5d4c3ce33db4711835456d22e7bfdbb/users/ba74f13f2a1e445dab34258d50ec8012/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:36.630333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.630495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.651306 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 786/1577] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.652303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.664218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d92e49-ddc2-4341-9b10-a48b7b5a937a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.695612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8f44-0a98-4c24-bfe7-d2ef7efad966 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.700671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.701385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.701698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.701977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.702662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.704603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.724656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.725343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.725629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.725908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.726634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.728239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.730534 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 792/1578] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.731924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.739744 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 787/1579] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.740637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.750722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa3b8c-dd81-484c-9b58-5203e30d569f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.767878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:36.797053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867f2d4-edd0-47b4-9ba0-829b5f58571b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.801721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.802380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.802658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.803127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.803645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.805366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.808673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.809414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.809702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.809982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.810673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.812557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.815785 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 793/1580] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.816642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.826950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86fdb4-d517-47aa-a0ca-81ad006f5bc9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.832197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b04f-d5ec-45ea-8ea4-b084afe96f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.832900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b04f-d5ec-45ea-8ea4-b084afe96f71 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.833417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b04f-d5ec-45ea-8ea4-b084afe96f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.833551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b04f-d5ec-45ea-8ea4-b084afe96f71 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.834141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b04f-d5ec-45ea-8ea4-b084afe96f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.836049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b04f-d5ec-45ea-8ea4-b084afe96f71 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.839267 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 788/1581] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.839267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.857698 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 794/1582] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.859219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.859513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.859788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.861402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:36.877528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:36.878766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:36.914430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31812f3-8897-4c55-aabd-f6c162e2d6e0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.919525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.920225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.920510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.920787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.921574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.923179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.933429 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 789/1583] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.934465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.944041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcfb2a-7523-4d0c-8c6e-588f34634053 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.946740 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 795/1584] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:36.947722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.948691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.949923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.950321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.950658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.951496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.952978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.958915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61eda9-a3c0-4bb1-8f8b-79578a855473 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.963618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.967443 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 790/1585] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.967616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.967616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.967792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.967889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.967889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.968160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.977622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44df39-0280-42b7-b4ab-71f4bea7c226 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:36.983381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:36.984061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:36.984348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:36.984629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:36.985400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:36.986994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:36.992084 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 796/1586] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:36.993009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:36.998130 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 791/1587] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:36.998791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.007595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3219-538a-42de-acc5-ba23098edc21 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.008323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdb4ac-cba0-4071-9a8a-573d6797eee6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.012803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.013616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.013816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.013950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.014197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.014473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.014758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.014930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.015023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.015808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.016573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.017757 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.028236 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 797/1588] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.029410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.039728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085846a-ec31-4464-a1ef-21660ad11445 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.045630 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 792/1589] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:36 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:37.045630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.045894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.045894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.045894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.045894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.046693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.048326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.052755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbc69-9327-4ca9-986f-72b770ec1581 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.057390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.058063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.058342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.058614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.058902 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 798/1590] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.059888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.061715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.063608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.078264 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 793/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.078264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.085358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3c7c-e25c-4fb2-a979-393a925c7309 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.090960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.091627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.091913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.092189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.092899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.094542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.108219 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 794/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.108219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.115468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6923f-9c6d-4858-9de7-c86e5f397659 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.120077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.120715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.120994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.121898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.122701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904b7d5-bb6f-4ecf-ad09-e64f2b5b82bc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.122821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.124297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.126367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.127008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.127291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.127623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.134013 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 795/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.134769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.139992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.141513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.144445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5c7b5-d2bb-44a0-92c2-7df0a5eba051 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.149043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.149916 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.150195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.150466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] PATH_INFO: `/v3/projects/64ad7f3247aa401e896ba1d99492bd70/users/d4ede22d723b405ab615c7c3fb2bdbab/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.151252 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 799/1594] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:37.152007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.161654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca066-aaa9-41df-85a2-39548bf00d81 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.166318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.167211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.167491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.167759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] PATH_INFO: `/v3/projects/84ff2dcb024e47cd94bdfcf0f6078577/users/3f33a56c887b47e590d31b543ced5aa4/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.170079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ad7f3247aa401e896ba1d99492bd70, user_id=d4ede22d723b405ab615c7c3fb2bdbab, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.171670 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:47:37.171670 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:47:37.171670 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:47:37.173966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.184896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.188668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ff2dcb024e47cd94bdfcf0f6078577, user_id=3f33a56c887b47e590d31b543ced5aa4, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.190534 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 796/1595] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:37 2022] PUT /identity/v3/projects/64ad7f3247aa401e896ba1d99492bd70/users/d4ede22d723b405ab615c7c3fb2bdbab/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:37.191748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.192154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.209399 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 800/1596] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:37 2022] PUT /identity/v3/projects/84ff2dcb024e47cd94bdfcf0f6078577/users/3f33a56c887b47e590d31b543ced5aa4/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:37.210257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.271233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6221f-3940-45b1-8724-414de0b1b93b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.286087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1021-710b-4c2f-93c0-d6236116e761 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.290818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.291576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.291764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.292146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.292989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.294432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.295457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.306459 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 801/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.307393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.318839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8b603-9067-4ace-8b2f-f9aa9aaa1b3e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.325653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.326130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.326480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.331358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] PATH_INFO: `/v3/projects/c7b8ddc7110b42a1a9d236ace4a93ae0/users/9684244d18724a9c83f70b4ed46e540a/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.351012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.351696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.351985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.352263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.352995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.354685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.355623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b8ddc7110b42a1a9d236ace4a93ae0, user_id=9684244d18724a9c83f70b4ed46e540a, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.359922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.365791 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 797/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.366722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.378094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f1dd6-d659-4382-a4ca-70b9ced0d111 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.380512 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 802/1599] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:37 2022] PUT /identity/v3/projects/c7b8ddc7110b42a1a9d236ace4a93ae0/users/9684244d18724a9c83f70b4ed46e540a/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:37.381947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.444602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b19a94-8b50-4092-8257-3cfd20f7c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.445656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19a94-8b50-4092-8257-3cfd20f7c128 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.445940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19a94-8b50-4092-8257-3cfd20f7c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.446270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19a94-8b50-4092-8257-3cfd20f7c128 admin admin] PATH_INFO: `/v3/projects/f32a1c32bd214356b5d7c9b5386cea11/users/523399e8e7dd435fbd7cd7ccadb3e32a/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.465702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b19a94-8b50-4092-8257-3cfd20f7c128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32a1c32bd214356b5d7c9b5386cea11, user_id=523399e8e7dd435fbd7cd7ccadb3e32a, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.468573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b19a94-8b50-4092-8257-3cfd20f7c128 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.486635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65593f54-eeca-432c-949b-b7c0f5f515ae admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.495841 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 798/1600] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:37 2022] PUT /identity/v3/projects/f32a1c32bd214356b5d7c9b5386cea11/users/523399e8e7dd435fbd7cd7ccadb3e32a/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:37.497865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.498165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.498444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.527012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] MFA Rules not processed for user `d4ede22d723b405ab615c7c3fb2bdbab`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:37.529507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:37.562654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478f7fc-16cf-4c98-aa8c-d1d685abd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.563350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f7fc-16cf-4c98-aa8c-d1d685abd5ac admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.563688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f7fc-16cf-4c98-aa8c-d1d685abd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.563970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f7fc-16cf-4c98-aa8c-d1d685abd5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.565156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478f7fc-16cf-4c98-aa8c-d1d685abd5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.567095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478f7fc-16cf-4c98-aa8c-d1d685abd5ac admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.580767 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 803/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.582283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb2a1-3717-4946-adf5-9a9efff52386 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.582629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb2a1-3717-4946-adf5-9a9efff52386 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.582915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb2a1-3717-4946-adf5-9a9efff52386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.605013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.616797 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 799/1602] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:37.617546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.631976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca55f8-7fce-434f-affa-be8b4011768d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.632428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-34edb2a1-3717-4946-adf5-9a9efff52386 None None] MFA Rules not processed for user `3f33a56c887b47e590d31b543ced5aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:37.633012 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-34edb2a1-3717-4946-adf5-9a9efff52386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:37.638103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.639369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.639741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.640672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] PATH_INFO: `/v3/projects/d6700b35745e4290b820f91719b249d4/users/d23ca857b76540ce83053424b710697b/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.666619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6700b35745e4290b820f91719b249d4, user_id=d23ca857b76540ce83053424b710697b, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.670612 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.687587 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 800/1603] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:37 2022] PUT /identity/v3/projects/d6700b35745e4290b820f91719b249d4/users/d23ca857b76540ce83053424b710697b/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:37.688515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.698012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.718890 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 804/1604] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:37.720804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.721094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.721407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.753008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] MFA Rules not processed for user `9684244d18724a9c83f70b4ed46e540a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:37.754197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:37.763549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6629-3527-468a-9172-3d2863d5a5c0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.768689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629211a4-d546-4c52-b919-88b5a29eefb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.778873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629211a4-d546-4c52-b919-88b5a29eefb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.778873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629211a4-d546-4c52-b919-88b5a29eefb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.778873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629211a4-d546-4c52-b919-88b5a29eefb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.778873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629211a4-d546-4c52-b919-88b5a29eefb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.780832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629211a4-d546-4c52-b919-88b5a29eefb3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.795008 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 801/1605] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:37.795008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.795008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.795008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.826585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] MFA Rules not processed for user `523399e8e7dd435fbd7cd7ccadb3e32a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:37.827625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:37.843702 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 805/1606] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:37.844815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.859208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f556ea-322f-4c0d-949e-15f4fe60e6f9 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.865388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3f19-5bf8-4f2b-bbf0-08b4239bc945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:37.866195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3f19-5bf8-4f2b-bbf0-08b4239bc945 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.868020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3f19-5bf8-4f2b-bbf0-08b4239bc945 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.868309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3f19-5bf8-4f2b-bbf0-08b4239bc945 admin admin] PATH_INFO: `/v3/projects/779c7b393d37486eadf1fdc94edf7e59/users/2335faffe08d4c75ab85aa124819c513/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.890555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3f19-5bf8-4f2b-bbf0-08b4239bc945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779c7b393d37486eadf1fdc94edf7e59, user_id=2335faffe08d4c75ab85aa124819c513, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:37.893288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3f19-5bf8-4f2b-bbf0-08b4239bc945 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:37.908584 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 806/1607] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:37 2022] PUT /identity/v3/projects/779c7b393d37486eadf1fdc94edf7e59/users/2335faffe08d4c75ab85aa124819c513/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:37.910080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f46d-d835-4a58-a758-7386f2244e3a None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.910370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f46d-d835-4a58-a758-7386f2244e3a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.910651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f46d-d835-4a58-a758-7386f2244e3a None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.912595 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 807/1608] 10.222.0.45 () {54 vars in 961 bytes} [Mon May 23 12:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:37.913696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:37.914043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:37.914327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:37.923212 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 802/1609] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:37.924395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:37.937026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13fe59-44d5-4421-8fb8-2a95fcc75d3d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:37.937856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:37.939379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.005073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.005407 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 808/1610] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.006257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.006377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.006797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.007069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.007761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.009786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.015404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.021383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94132c6a-01c2-48e1-acfd-869624388964 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.032119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a9c8-f444-4d48-8b9e-fc6dca222b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.033164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a9c8-f444-4d48-8b9e-fc6dca222b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.033603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a9c8-f444-4d48-8b9e-fc6dca222b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.033907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a9c8-f444-4d48-8b9e-fc6dca222b0e admin admin] PATH_INFO: `/v3/projects/b0f9c2c88e8c4039ab7bbfaae428a44c/users/9a54d0166c27450f99507793483542ff/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.038102 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 803/1611] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:37 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:38.038964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.055135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a9c8-f444-4d48-8b9e-fc6dca222b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f9c2c88e8c4039ab7bbfaae428a44c, user_id=9a54d0166c27450f99507793483542ff, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.057760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a9c8-f444-4d48-8b9e-fc6dca222b0e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.064977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.077687 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 809/1612] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:38 2022] PUT /identity/v3/projects/b0f9c2c88e8c4039ab7bbfaae428a44c/users/9a54d0166c27450f99507793483542ff/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:38.078901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a90c1-7d51-4c5c-b3d5-92238159585c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.079264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a90c1-7d51-4c5c-b3d5-92238159585c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.079617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a90c1-7d51-4c5c-b3d5-92238159585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.107215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-519a90c1-7d51-4c5c-b3d5-92238159585c None None] MFA Rules not processed for user `ba74f13f2a1e445dab34258d50ec8012`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:38.108450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-519a90c1-7d51-4c5c-b3d5-92238159585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.116932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ac00-42ef-442c-b6d0-b04d60a9047f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.173914 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 810/1613] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.175269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042476b-7c02-4c24-810a-a73dd7ec0a75 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.175565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042476b-7c02-4c24-810a-a73dd7ec0a75 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.175847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042476b-7c02-4c24-810a-a73dd7ec0a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.184447 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.185250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.185540 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.185818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.186517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.189080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.194041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b042476b-7c02-4c24-810a-a73dd7ec0a75 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:38.195259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b042476b-7c02-4c24-810a-a73dd7ec0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.203122 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 811/1614] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.204374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.204666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.204951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.222064 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 804/1615] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:38.222935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.225993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:38.227266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.279843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1225c-c20e-4747-8bc2-85433b898a20 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.283529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.284174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.284458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.284739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.297338 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 812/1616] 10.222.0.45 () {58 vars in 1058 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.298213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.299563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.350495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.351943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.359348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea5a-241d-4903-b7ec-26493874e99a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.361075 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 805/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:38.361960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.363465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda964b-e60b-43c6-9125-4d1f0adcb04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.364342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda964b-e60b-43c6-9125-4d1f0adcb04e service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.367221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.378347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda964b-e60b-43c6-9125-4d1f0adcb04e service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.378347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda964b-e60b-43c6-9125-4d1f0adcb04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.384046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.439142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a9878-19a7-468a-8174-b84cbbbc5c13 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.444048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadcd12-781a-4940-a65e-a1354b3ff1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.444940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcd12-781a-4940-a65e-a1354b3ff1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.445670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcd12-781a-4940-a65e-a1354b3ff1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.445670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcd12-781a-4940-a65e-a1354b3ff1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.446226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadcd12-781a-4940-a65e-a1354b3ff1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.448220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadcd12-781a-4940-a65e-a1354b3ff1c9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.451941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda964b-e60b-43c6-9125-4d1f0adcb04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.453605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda964b-e60b-43c6-9125-4d1f0adcb04e service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.467066 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 813/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:38.474126 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 806/1619] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:38.482846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.483316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.483702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.484820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.485633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.486086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.504845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:38.506312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.509490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] MFA Rules not processed for user `ba74f13f2a1e445dab34258d50ec8012`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:38.510745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.520685 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 814/1620] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.521553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.532339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecadbed-1a93-4689-aa3d-877f669a8f28 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.536366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.537185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.537585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.537970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.549566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.551660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.564054 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 815/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:38.565114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.576111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be179bda-4e75-4493-b4c5-00583fd9ca98 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.581891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.582787 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.583083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.583488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.584372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.586693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.591243 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 807/1622] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.592948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.609365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b09c25-2cd5-499c-9e1c-b19700c5c000 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.616109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.616767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.617102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.617401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.622877 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 816/1623] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:38.622877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.647974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc36c3-e21d-46e3-bc19-126b09b6eed1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.658821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.659971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.660302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.660589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.661389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.664105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.680003 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 817/1624] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:38.685620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.697880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.698200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2562-9b52-4b33-82de-3f96b7a784d5 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.701178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.703508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547acfe-7185-4f38-81c7-0f93344b4c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.704268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547acfe-7185-4f38-81c7-0f93344b4c8a service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.704808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547acfe-7185-4f38-81c7-0f93344b4c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.704945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547acfe-7185-4f38-81c7-0f93344b4c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.713124 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 808/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:38.714021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.727656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a2743-c7a2-4b78-9b29-0affab8f1788 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.732597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547acfe-7185-4f38-81c7-0f93344b4c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.734104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547acfe-7185-4f38-81c7-0f93344b4c8a service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.739272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.741599 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.742000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.743220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.744083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.747218 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 818/1626] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:38.753848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.762860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b13d9-78f1-4f33-9c1e-8761991d16fd None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.765098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b13d9-78f1-4f33-9c1e-8761991d16fd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.765824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b13d9-78f1-4f33-9c1e-8761991d16fd None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.775738 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 809/1627] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:38.776697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.782301 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 819/1628] 10.222.0.45 () {54 vars in 961 bytes} [Mon May 23 12:47:38 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:38.784937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.786449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.786847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.818661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cacace-cc84-4fb6-baec-a0f9c98652e5 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.831070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:38.836370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:38.836883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:38.837367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] PATH_INFO: `/v3/projects/6fc9976fb9c14b26a623ef3fd0e673d0/users/3a766cb8182c4461ae09e870da533101/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:38.839408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:38.843476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:38.875235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc9976fb9c14b26a623ef3fd0e673d0, user_id=3a766cb8182c4461ae09e870da533101, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:38.880483 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 820/1629] 10.222.0.45 () {58 vars in 1058 bytes} [Mon May 23 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:38.882285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.885575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:38.911929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dcf66-2e1f-46c1-83c2-655b09bc6f09 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:38.912597 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 810/1630] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:38 2022] PUT /identity/v3/projects/6fc9976fb9c14b26a623ef3fd0e673d0/users/3a766cb8182c4461ae09e870da533101/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:38.913607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:38.924088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:39.063106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.064018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.064375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.064794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] PATH_INFO: `/v3/projects/79ea4ffe4a394c92aec916a4abf19fed/users/bb52a51a0180408dae1fba29f252873a/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.093106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daefb1-6ffe-447f-b788-ab432af970a0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.108470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.109420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.110369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.110576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.120484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ea4ffe4a394c92aec916a4abf19fed, user_id=bb52a51a0180408dae1fba29f252873a, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.131811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.167450 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 821/1631] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:38 2022] PUT /identity/v3/projects/79ea4ffe4a394c92aec916a4abf19fed/users/bb52a51a0180408dae1fba29f252873a/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:39.168939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.224179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.226147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.243215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:39.250618 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 811/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:39.251925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.310612 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e102095-de7d-43db-a00a-3b3a2439a7d8 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.312550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9469c-4c87-41e1-ac9e-ebfae653ea4b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.321318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.322954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.324209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.325987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.326445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.330899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.331354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.331354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.331354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.331354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.331354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.332666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.349898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 812/1633] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:39.352140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.364427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d20c-1a9b-42ab-a91a-20e855d2f11f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.365337 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 822/1634] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:39.366679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.394011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245993-3bd0-44d7-ae32-d14e211de62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.395140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245993-3bd0-44d7-ae32-d14e211de62b admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.397014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245993-3bd0-44d7-ae32-d14e211de62b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.398629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245993-3bd0-44d7-ae32-d14e211de62b admin admin] PATH_INFO: `/v3/projects/79ea4ffe4a394c92aec916a4abf19fed/users/bb52a51a0180408dae1fba29f252873a/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.406369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50245993-3bd0-44d7-ae32-d14e211de62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ea4ffe4a394c92aec916a4abf19fed, user_id=bb52a51a0180408dae1fba29f252873a, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.416261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50245993-3bd0-44d7-ae32-d14e211de62b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.418895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce161-5ad4-4503-9288-c88fc75bb688 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.435743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8fdf2-da88-4245-a37c-2d4d8b9725e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.436658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8fdf2-da88-4245-a37c-2d4d8b9725e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.437122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8fdf2-da88-4245-a37c-2d4d8b9725e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.437368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8fdf2-da88-4245-a37c-2d4d8b9725e8 admin admin] PATH_INFO: `/v3/projects/6fc9976fb9c14b26a623ef3fd0e673d0/users/3a766cb8182c4461ae09e870da533101/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.439427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8fdf2-da88-4245-a37c-2d4d8b9725e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc9976fb9c14b26a623ef3fd0e673d0, user_id=3a766cb8182c4461ae09e870da533101, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.442283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8fdf2-da88-4245-a37c-2d4d8b9725e8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.481620 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 813/1636] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:39 2022] PUT /identity/v3/projects/79ea4ffe4a394c92aec916a4abf19fed/users/bb52a51a0180408dae1fba29f252873a/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:39.482189 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 823/1636] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:39 2022] PUT /identity/v3/projects/6fc9976fb9c14b26a623ef3fd0e673d0/users/3a766cb8182c4461ae09e870da533101/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:39.484461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30468f7-199b-4a56-8eb4-7ae56f69d9eb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.484461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30468f7-199b-4a56-8eb4-7ae56f69d9eb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.484697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30468f7-199b-4a56-8eb4-7ae56f69d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.488491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.491121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.491910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.548037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c30468f7-199b-4a56-8eb4-7ae56f69d9eb None None] MFA Rules not processed for user `3a766cb8182c4461ae09e870da533101`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:39.549453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c30468f7-199b-4a56-8eb4-7ae56f69d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:39.569653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] MFA Rules not processed for user `bb52a51a0180408dae1fba29f252873a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:39.575978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:39.711853 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 824/1637] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:39.713492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d09573-9ded-4155-b1d4-f39b41207221 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.713961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d09573-9ded-4155-b1d4-f39b41207221 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.714412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d09573-9ded-4155-b1d4-f39b41207221 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.725473 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 825/1638] 10.222.0.45 () {54 vars in 912 bytes} [Mon May 23 12:47:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:39.727445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ac62f-0e42-40ad-ba2b-5a268b76dd7f None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.727744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ac62f-0e42-40ad-ba2b-5a268b76dd7f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.728028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ac62f-0e42-40ad-ba2b-5a268b76dd7f None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.729504 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 826/1639] 10.222.0.45 () {54 vars in 912 bytes} [Mon May 23 12:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:39.731416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea7ec-7d1b-4aa4-8b3b-22ac9ce4b77d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.731901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea7ec-7d1b-4aa4-8b3b-22ac9ce4b77d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.732325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea7ec-7d1b-4aa4-8b3b-22ac9ce4b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.740859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:39.754447 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 814/1640] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:39.758717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.768848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-620ea7ec-7d1b-4aa4-8b3b-22ac9ce4b77d None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:39.772287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-620ea7ec-7d1b-4aa4-8b3b-22ac9ce4b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:39.896140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1eb2d-72d6-4abc-be79-6d96a3c023d3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.901383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.902107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.902451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.902821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.903545 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 827/1641] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:39.905642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.906412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.907076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:39.921172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:39.924207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:39.935745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:39.937347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:39.951266 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 828/1642] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:39.952437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.958862 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 815/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:39.966538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:39.968557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:39.977071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7c580-e724-4f24-865a-80e9164054e5 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:39.985345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:39.986941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:39.987382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:39.987848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.005343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:40.007491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:40.014739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:40.029863 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 829/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:40.031515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:40.050345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eddf2-f871-4cd9-9c5f-99332aaa80b3 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:40.055529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:40.056313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.056704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.057191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.071089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:40.072949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:40.108038 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 830/1645] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:40.136278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0562-95d8-4b9f-b568-2dd3576d6416 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:40.152172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:40.157637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.157947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.158238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.191214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:40.193448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:40.244562 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 816/1646] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:40.278389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:40.288182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:40.297480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2947b33-6996-4150-84d8-bea5405def74 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:40.302078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78964dd-8c5f-4978-a7f6-66e2d5f38a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:40.303770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78964dd-8c5f-4978-a7f6-66e2d5f38a95 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.303770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78964dd-8c5f-4978-a7f6-66e2d5f38a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.304266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78964dd-8c5f-4978-a7f6-66e2d5f38a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.312418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968b6a1-dc31-4e22-a144-e2dcfda53a45 service glance] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:40.317701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d9c4c-0ff7-463a-b2b5-1346a2083b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:40.318780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d9c4c-0ff7-463a-b2b5-1346a2083b7b service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.319236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d9c4c-0ff7-463a-b2b5-1346a2083b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.319719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d9c4c-0ff7-463a-b2b5-1346a2083b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.401967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d9c4c-0ff7-463a-b2b5-1346a2083b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:40.404319 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d9c4c-0ff7-463a-b2b5-1346a2083b7b service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:40.443487 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 817/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:47:40.445030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78964dd-8c5f-4978-a7f6-66e2d5f38a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:40.449873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78964dd-8c5f-4978-a7f6-66e2d5f38a95 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:40.474267 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 831/1648] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:40.714969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bede2e6-2a93-402d-9cfb-cddd858259de None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.717239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bede2e6-2a93-402d-9cfb-cddd858259de None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.717533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bede2e6-2a93-402d-9cfb-cddd858259de None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.719477 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 818/1649] 10.222.0.45 () {54 vars in 912 bytes} [Mon May 23 12:47:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:40.726282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.726984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.727475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.794007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:40.795801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:40.889128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bede2e6-2a93-402d-9cfb-cddd858259de None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:40.896810 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 832/1650] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:40.935051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:40.948604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ebc7f-0d07-4664-9a91-ee562aa694b2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:40.955762 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda3266-3574-4c82-86b7-e3d43613cab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:40.956681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3266-3574-4c82-86b7-e3d43613cab0 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:40.956975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3266-3574-4c82-86b7-e3d43613cab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:40.957470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3266-3574-4c82-86b7-e3d43613cab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:40.969306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:40.969810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda3266-3574-4c82-86b7-e3d43613cab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:40.972605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda3266-3574-4c82-86b7-e3d43613cab0 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:40.994630 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 833/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:47:41.033890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bede2e6-2a93-402d-9cfb-cddd858259de None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:41.045901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:41.047145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:41.047145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:41.047472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] PATH_INFO: `/v3/users/d4ede22d723b405ab615c7c3fb2bdbab` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:41.048776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ede22d723b405ab615c7c3fb2bdbab)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:41.050775 dv-cinder-master-3-smb devstack@keystone.service[90355]: WARNING py.warnings [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:47:41.050775 dv-cinder-master-3-smb devstack@keystone.service[90355]: warnings.warn(msg) May 23 12:47:41.050775 dv-cinder-master-3-smb devstack@keystone.service[90355]: May 23 12:47:41.052050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:41.160708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ede22d723b405ab615c7c3fb2bdbab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:41.163551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:41.163845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:41.164128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:41.204137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ede22d723b405ab615c7c3fb2bdbab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:41.210401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ede22d723b405ab615c7c3fb2bdbab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:41.230204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] MFA Rules not processed for user `9a54d0166c27450f99507793483542ff`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:41.235323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:41.283947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ede22d723b405ab615c7c3fb2bdbab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:41.296592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-29ac562b-7475-458c-bc39-c5f40b05ff57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ede22d723b405ab615c7c3fb2bdbab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:41.307075 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 819/1652] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:40 2022] DELETE /identity/v3/users/d4ede22d723b405ab615c7c3fb2bdbab => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:47:41.315555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:41.315887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:41.316185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:41.371203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:41.375798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:41.377123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:41.387470 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 834/1653] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:41.388734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:41.390827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:41.430194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb9db6-3797-457f-9a0b-91992428d288 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:41.527096 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 820/1654] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:41.547018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:41.548487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:41.558566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:41.561889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:41.562440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:41.562785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:41.564064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:41.571608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:41.681498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4755ff-6ac1-4da9-b5a9-43d170f41145 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:41.694061 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 835/1655] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:41 2022] POST /identity/v3/projects => generated 403 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:41.697710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:41.726262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:41.830997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:41.860755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:41.860755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:41.860755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:41.947074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3308885-504f-4162-8df0-7cc29666b080 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:41.965932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:41.967338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:41.967464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:41.970891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:41.971642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:41.980041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:42.065025 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 836/1656] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:41 2022] POST /identity/v3/users => generated 308 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:42.066023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:42.084997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:42.091484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:42.097986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03cfc-39c8-4f3a-a7a7-415b38d60ff9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:42.116487 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 821/1657] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:42.116791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:42.117509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:42.117797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:42.118078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:42.118819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:42.125990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:42.151972 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 837/1658] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:42.157163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:42.199153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600b09-9622-4783-bb91-b571c878093a service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:42.221976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:42.222928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:42.224327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:42.224621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] PATH_INFO: `/v3/projects/c5632f0d3a0f47779b144a0bf2d9ca70/users/f25786e3d2094c5ca8efdf165691b5a3/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:42.273054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5632f0d3a0f47779b144a0bf2d9ca70, user_id=f25786e3d2094c5ca8efdf165691b5a3, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:42.306410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:42.352321 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 822/1659] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:42 2022] PUT /identity/v3/projects/c5632f0d3a0f47779b144a0bf2d9ca70/users/f25786e3d2094c5ca8efdf165691b5a3/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:42.353177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:42.369659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478c0c-1c61-4dc1-8906-a49c62216cd0 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:42.468447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e736f4-d09e-4032-bc0f-a28b7449c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:42.469912 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e736f4-d09e-4032-bc0f-a28b7449c43c admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:42.470356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e736f4-d09e-4032-bc0f-a28b7449c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:42.470760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e736f4-d09e-4032-bc0f-a28b7449c43c admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:42.471660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e736f4-d09e-4032-bc0f-a28b7449c43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:42.473901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e736f4-d09e-4032-bc0f-a28b7449c43c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:42.475761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:42.498631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:42.507347 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 838/1660] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:42.512757 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ad0fa-1865-4752-aa49-8a7edfaa78a1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:42.519483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5d26e-42d3-4137-9859-689392a6f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:42.520875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d26e-42d3-4137-9859-689392a6f690 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:42.521314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d26e-42d3-4137-9859-689392a6f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:42.522300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d26e-42d3-4137-9859-689392a6f690 admin admin] PATH_INFO: `/v3/projects/c5632f0d3a0f47779b144a0bf2d9ca70/users/f25786e3d2094c5ca8efdf165691b5a3/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:42.525334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5d26e-42d3-4137-9859-689392a6f690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5632f0d3a0f47779b144a0bf2d9ca70, user_id=f25786e3d2094c5ca8efdf165691b5a3, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:42.528534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5d26e-42d3-4137-9859-689392a6f690 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:42.556475 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 823/1661] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:42 2022] PUT /identity/v3/projects/c5632f0d3a0f47779b144a0bf2d9ca70/users/f25786e3d2094c5ca8efdf165691b5a3/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:42.819323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232a3a-beed-459a-bc86-107f8d93eec8 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:42.819675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232a3a-beed-459a-bc86-107f8d93eec8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:42.819898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232a3a-beed-459a-bc86-107f8d93eec8 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:42.821540 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 839/1662] 10.222.0.45 () {54 vars in 960 bytes} [Mon May 23 12:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:42.829897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:42.830492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:42.830492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:42.865487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:42.866766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:43.037737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232a3a-beed-459a-bc86-107f8d93eec8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:43.038177 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 824/1663] 10.222.0.45 () {58 vars in 1057 bytes} [Mon May 23 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:43.062573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232a3a-beed-459a-bc86-107f8d93eec8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:43.078354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:43.079355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:43.079355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:43.079578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:43.081509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:43.126864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:43.128439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece776f-9c5f-440e-8bf1-4111bda8d38f service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:43.152488 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 840/1664] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:44.082069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:44.084069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:44.175413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:44.283230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27e9d-d100-4e2c-959d-65be369a6822 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:44.307082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:44.308205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:44.309047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:44.309513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] PATH_INFO: `/v3/projects/64ad7f3247aa401e896ba1d99492bd70` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:44.311927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ad7f3247aa401e896ba1d99492bd70)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:44.315931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:44.491861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ad7f3247aa401e896ba1d99492bd70', 'request_id': 'req-9ce68b19-6edb-4f00-ad60-05595dc0adcf'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:44.506481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ad7f3247aa401e896ba1d99492bd70', 'request_id': 'req-9ce68b19-6edb-4f00-ad60-05595dc0adcf'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:44.542366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ad7f3247aa401e896ba1d99492bd70', 'request_id': 'req-9ce68b19-6edb-4f00-ad60-05595dc0adcf'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:44.578006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] The token cache is being invalidate because project 64ad7f3247aa401e896ba1d99492bd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:47:44.578297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:44.579446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ce68b19-6edb-4f00-ad60-05595dc0adcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:44.589112 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 825/1665] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:47:44 2022] DELETE /identity/v3/projects/64ad7f3247aa401e896ba1d99492bd70 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:44.592107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:44.592633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:44.592784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:44.662077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:44.670944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:44.884906 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 841/1666] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:44.893166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:44.893483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:44.893768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:44.958273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:44.959787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:44.987059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:44.987885 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 826/1667] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:45.011180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca2fc7-6272-410c-be3c-cfadefacb830 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:45.028083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:45.028887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:45.029160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:45.029593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:45.030345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:45.030658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:45.032305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:45.086834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:45.096950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02594-5b9a-4c87-a499-7bd6268f77ed None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:45.111802 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 842/1668] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:45.118178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:45.119089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:45.119519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:45.119948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:45.129894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:45.132471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:45.192566 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 827/1669] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:45 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:47:45.197056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:45.211841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341682-9f7d-404a-868f-e29c35aef000 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:45.473867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:45.474563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:45.474839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:45.475116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:45.475826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:45.477835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:45.590785 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 843/1670] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:45 2022] POST /identity/v3/users => generated 283 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:45.592133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:45.605058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad472-55ab-4bbc-88e2-5fa76aa198be admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:45.639897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f30fea-f80b-4ac0-a8d1-d2845245b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:45.640590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f30fea-f80b-4ac0-a8d1-d2845245b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:45.640876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f30fea-f80b-4ac0-a8d1-d2845245b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:45.641166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f30fea-f80b-4ac0-a8d1-d2845245b2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:45.641935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f30fea-f80b-4ac0-a8d1-d2845245b2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:45.643544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f30fea-f80b-4ac0-a8d1-d2845245b2f5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:46.194320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:46.199302 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 828/1671] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 606 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:46.215261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba2840-7d93-42f5-a034-aa2c0775289b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:46.235022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:46.235805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:46.236154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:46.236504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:46.237377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:46.240107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:46.283361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:46.283361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:46.283361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:46.298025 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 844/1672] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:47:46.299938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:46.322826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] MFA Rules not processed for user `f25786e3d2094c5ca8efdf165691b5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:46.324744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:46.330633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0ed8-c147-47f8-9cd4-02133bdc6c24 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:46.349068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35025a1-1429-4ede-b4fd-96223ac2c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:46.354236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35025a1-1429-4ede-b4fd-96223ac2c42f admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:46.355972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35025a1-1429-4ede-b4fd-96223ac2c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:46.357578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35025a1-1429-4ede-b4fd-96223ac2c42f admin admin] PATH_INFO: `/v3/projects/ab96ebe1a71849728029f6aef1d28713/users/d917547a4ae64c37a00577b76ef68bbd/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:46.434543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35025a1-1429-4ede-b4fd-96223ac2c42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab96ebe1a71849728029f6aef1d28713, user_id=d917547a4ae64c37a00577b76ef68bbd, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:46.442558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35025a1-1429-4ede-b4fd-96223ac2c42f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:46.481026 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 845/1673] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:46 2022] PUT /identity/v3/projects/ab96ebe1a71849728029f6aef1d28713/users/d917547a4ae64c37a00577b76ef68bbd/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:47:46.495496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1a7d8-2ab4-4afc-9d9f-d79cd31fbf7d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:46.495791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1a7d8-2ab4-4afc-9d9f-d79cd31fbf7d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:46.497769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1a7d8-2ab4-4afc-9d9f-d79cd31fbf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:46.598541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a4e1a7d8-2ab4-4afc-9d9f-d79cd31fbf7d None None] MFA Rules not processed for user `d917547a4ae64c37a00577b76ef68bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:46.599519 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 829/1674] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:46.607491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a4e1a7d8-2ab4-4afc-9d9f-d79cd31fbf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:46.627897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:46.772238 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 846/1675] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:46.778798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:46.796847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:46.805764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2a35-b624-4aae-a20c-dd3e8fbe4f38 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.008152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.008443 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.008726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.012713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.013672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.014165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.014638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.015643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:47.020103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:47.052955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:47.064760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:47.091609 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 830/1676] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:46 2022] POST /identity/v3/projects => generated 363 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:47.095953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:47.263283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2eea-2fa2-4802-91e9-4ebab9622d70 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.263874 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 847/1677] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:47.286427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.286623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.287017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.287489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.288178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:47.292852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:47.367730 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 831/1678] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:47 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:47:47.372581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:47.394098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d0f9-9ccc-4bf3-aeab-81627b597afc None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.404740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.408071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.410183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.411247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.412192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:47.418619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:47.449915 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 848/1679] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:47.451198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:47.465154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0742-ff4a-4c84-9882-7ce800f3710f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.480081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.481388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.481685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.485885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] PATH_INFO: `/v3/projects/ab6454bc43064654a95311cdc609cfe2/users/be66b6df13d348adb05462be707c6b72/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.520993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6454bc43064654a95311cdc609cfe2, user_id=be66b6df13d348adb05462be707c6b72, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:47.540951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:47.577476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:47.580522 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 832/1680] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:47 2022] PUT /identity/v3/projects/ab6454bc43064654a95311cdc609cfe2/users/be66b6df13d348adb05462be707c6b72/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:47.581654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:47.589034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:47.736635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:47.751593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88e09-d720-43c7-8ec9-6c4c4804a1da admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.767966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.768657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.768946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.770678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.771609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:47.778509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:47.804624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6c77-5dcc-4503-86ac-35049a4119a6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.811946 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 833/1681] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:47.816935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:47.847873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fb02-9ec3-4c04-b101-87d209001ed5 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:47.865192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15bc6e-cc9c-4d1d-a34d-57434b8bfbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.866098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15bc6e-cc9c-4d1d-a34d-57434b8bfbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.866387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15bc6e-cc9c-4d1d-a34d-57434b8bfbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.866671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15bc6e-cc9c-4d1d-a34d-57434b8bfbb0 admin admin] PATH_INFO: `/v3/projects/ab6454bc43064654a95311cdc609cfe2/users/be66b6df13d348adb05462be707c6b72/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.870656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15bc6e-cc9c-4d1d-a34d-57434b8bfbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6454bc43064654a95311cdc609cfe2, user_id=be66b6df13d348adb05462be707c6b72, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:47.874036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15bc6e-cc9c-4d1d-a34d-57434b8bfbb0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:47.904237 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 834/1682] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:47 2022] PUT /identity/v3/projects/ab6454bc43064654a95311cdc609cfe2/users/be66b6df13d348adb05462be707c6b72/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:47.914892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.915241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.915924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.920027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:47.951037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:47.951037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:47.951364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:47.951557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:47.978713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] MFA Rules not processed for user `be66b6df13d348adb05462be707c6b72`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:47.983306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:48.109226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:48.110874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:48.138063 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 849/1683] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:47:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 12:47:48.243720 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 835/1684] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:48.353013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:48.354601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:48.609031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbf0a4-663d-4f08-bddb-7b07228a6733 service swift] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:48.804400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ac4f-bf0d-4cb8-9a96-ea2745061ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:48.806280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ac4f-bf0d-4cb8-9a96-ea2745061ebc service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:48.806828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ac4f-bf0d-4cb8-9a96-ea2745061ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:48.807520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ac4f-bf0d-4cb8-9a96-ea2745061ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:48.823007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2ac4f-bf0d-4cb8-9a96-ea2745061ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:48.826964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2ac4f-bf0d-4cb8-9a96-ea2745061ebc service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:48.871970 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 850/1685] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:49.106591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:49.127964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6350d-6e32-4e25-9b21-571e3e0df14d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:49.140638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:49.147127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:49.147468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:49.147837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:49.251231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90552-cf2e-4bfa-a85f-42c923b89af4 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:49.251530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90552-cf2e-4bfa-a85f-42c923b89af4 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:49.251733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90552-cf2e-4bfa-a85f-42c923b89af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:49.275858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:49.288367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:49.302762 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 836/1686] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:49.318577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a6a90552-cf2e-4bfa-a85f-42c923b89af4 None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:49.322846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a6a90552-cf2e-4bfa-a85f-42c923b89af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:49.563446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:49.588098 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 851/1687] 10.222.0.55 () {58 vars in 1015 bytes} [Mon May 23 12:47:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:49.622514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:49.624714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:49.661333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06357bc-1e06-4b15-9a32-0f100179ba80 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:49.676299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e045d67-b11b-46a8-b107-8cea4353e768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:49.677955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045d67-b11b-46a8-b107-8cea4353e768 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:49.679152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045d67-b11b-46a8-b107-8cea4353e768 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:49.679626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045d67-b11b-46a8-b107-8cea4353e768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:49.717815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045d67-b11b-46a8-b107-8cea4353e768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:49.721768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045d67-b11b-46a8-b107-8cea4353e768 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:49.754976 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 837/1688] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:49.981945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a690-6547-4d6d-9e49-1e29e0582d11 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:49.982240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a690-6547-4d6d-9e49-1e29e0582d11 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:49.982527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a690-6547-4d6d-9e49-1e29e0582d11 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:49.985294 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 852/1689] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:47:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:50.096851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:50.097174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:50.097465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:50.156338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:50.158614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:50.385355 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:50.529005 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 838/1690] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:50.666553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a690-6547-4d6d-9e49-1e29e0582d11 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:50.674058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dbd1a690-6547-4d6d-9e49-1e29e0582d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:50.740657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a690-6547-4d6d-9e49-1e29e0582d11 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:50.756791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:50.761098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:50.764069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:50.765242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:50.796718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:50.828885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:50.863697 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 853/1691] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:51.253489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:51.255950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:51.584593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c623e1-be37-4ae4-ac09-e0793e57c2d0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:51.605062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:51.609453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:51.613080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:51.613452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] PATH_INFO: `/v3/users/523399e8e7dd435fbd7cd7ccadb3e32a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:51.619203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523399e8e7dd435fbd7cd7ccadb3e32a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:51.642037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:51.858721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523399e8e7dd435fbd7cd7ccadb3e32a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:51.877659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523399e8e7dd435fbd7cd7ccadb3e32a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:51.878254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523399e8e7dd435fbd7cd7ccadb3e32a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:51.922182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:51.923535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:51.946353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523399e8e7dd435fbd7cd7ccadb3e32a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:51.958364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428e1e4-02ed-4412-bef3-b3d8e1985d07 service placement] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:51.971541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ad0a9218-f360-4a85-af55-99e3feafe066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523399e8e7dd435fbd7cd7ccadb3e32a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:51.979963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:51.982276 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 839/1692] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:51 2022] DELETE /identity/v3/users/523399e8e7dd435fbd7cd7ccadb3e32a => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:51.988499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410c14-f03f-43a7-b290-80f3adf4fe5d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:51.989173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410c14-f03f-43a7-b290-80f3adf4fe5d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:51.989289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:51.989538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:51.989826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] PATH_INFO: `/v3/users/9684244d18724a9c83f70b4ed46e540a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:51.990210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410c14-f03f-43a7-b290-80f3adf4fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:51.991270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9684244d18724a9c83f70b4ed46e540a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:51.993522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:52.063862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4e410c14-f03f-43a7-b290-80f3adf4fe5d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:52.074333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4e410c14-f03f-43a7-b290-80f3adf4fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:52.132985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9684244d18724a9c83f70b4ed46e540a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:52.158027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9684244d18724a9c83f70b4ed46e540a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:52.160390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9684244d18724a9c83f70b4ed46e540a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:52.181225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9684244d18724a9c83f70b4ed46e540a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:52.182350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9b8adf4f-4e22-4170-9faa-28ade5baf234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9684244d18724a9c83f70b4ed46e540a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:52.241632 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 854/1693] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:51 2022] DELETE /identity/v3/users/9684244d18724a9c83f70b4ed46e540a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:52.245831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3b80-396b-48ea-9a98-aa9a47e5b954 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:52.246773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3b80-396b-48ea-9a98-aa9a47e5b954 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:52.247073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3b80-396b-48ea-9a98-aa9a47e5b954 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:52.250398 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 855/1694] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:47:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:47:52.254037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:52.255953 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:52.257646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:52.319132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:52.322196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:52.341079 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 840/1695] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:47:52.341079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:52.341079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:52.341079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:52.364584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:52.398431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:52.399820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:52.536263 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 856/1696] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:52.682243 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 841/1697] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:52.892745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:52.895154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:52.925863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:52.928229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:52.992071 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd17b-24c4-450b-be3c-b9cd0b5f1f75 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:53.051508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0bc40-c94b-4d5d-b871-1db4e14363c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:53.075763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0bc40-c94b-4d5d-b871-1db4e14363c1 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:53.075763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0bc40-c94b-4d5d-b871-1db4e14363c1 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:53.075763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0bc40-c94b-4d5d-b871-1db4e14363c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:53.076444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8289c6-5054-47a2-bb16-5f17f5ccfaaa None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:53.082076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:53.082932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:53.083264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:53.083494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:53.114489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:53.116229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:53.149746 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 857/1698] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:53.150672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:53.152158 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:53.164556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0bc40-c94b-4d5d-b871-1db4e14363c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:53.165962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:53.171736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4bb70-2cb0-4bf0-a75b-26cb7b831593 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:53.176157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0bc40-c94b-4d5d-b871-1db4e14363c1 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:53.181416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:53.182132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:53.182423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:53.182703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:53.210710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:53.213817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:53.238632 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 858/1699] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:53.239389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:53.245773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:53.254348 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 842/1700] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:53.280353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6b597-f75a-4c6e-86f1-5694d46186d1 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:53.293015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:53.293920 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:53.294205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:53.294484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] PATH_INFO: `/v3/users/d917547a4ae64c37a00577b76ef68bbd` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:53.299944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d917547a4ae64c37a00577b76ef68bbd)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:53.305967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:53.470902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd917547a4ae64c37a00577b76ef68bbd'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:53.525204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd917547a4ae64c37a00577b76ef68bbd'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:53.526093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd917547a4ae64c37a00577b76ef68bbd'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:53.549247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd917547a4ae64c37a00577b76ef68bbd'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:53.550009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd917547a4ae64c37a00577b76ef68bbd'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:53.649852 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 859/1701] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:53 2022] DELETE /identity/v3/users/d917547a4ae64c37a00577b76ef68bbd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:53.651712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:53.653171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:53.653774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:53.692568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:53.697766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:53.949338 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 843/1702] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:53.973009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:53.974891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:54.165021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06707ec-3f18-4fb2-983e-862d1505531e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:54.174480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85d4eb-1460-47a8-aa09-6b2999d63ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:54.175164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d4eb-1460-47a8-aa09-6b2999d63ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:54.175518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d4eb-1460-47a8-aa09-6b2999d63ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:54.175726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d4eb-1460-47a8-aa09-6b2999d63ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:54.211233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85d4eb-1460-47a8-aa09-6b2999d63ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:54.212729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85d4eb-1460-47a8-aa09-6b2999d63ec1 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:54.237903 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 860/1703] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:54.358130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:54.360781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:54.405050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596a13-9bc3-42ea-80c7-96f509e2eca4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:54.410934 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:54.412179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:54.413086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:54.413518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] PATH_INFO: `/v3/projects/f32a1c32bd214356b5d7c9b5386cea11` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:54.415564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32a1c32bd214356b5d7c9b5386cea11)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:54.430240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:54.615430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32a1c32bd214356b5d7c9b5386cea11', 'request_id': 'req-3ff87169-d6d2-4529-9d7c-505d6bbf751f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:54.674692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32a1c32bd214356b5d7c9b5386cea11', 'request_id': 'req-3ff87169-d6d2-4529-9d7c-505d6bbf751f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:54.718286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32a1c32bd214356b5d7c9b5386cea11', 'request_id': 'req-3ff87169-d6d2-4529-9d7c-505d6bbf751f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:54.795498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] The token cache is being invalidate because project f32a1c32bd214356b5d7c9b5386cea11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:47:54.795833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:54.818335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:54.834035 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 844/1704] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:47:54 2022] DELETE /identity/v3/projects/f32a1c32bd214356b5d7c9b5386cea11 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:54.835739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b10b9-ee79-4698-a8cf-d6f09164d3b1 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:54.836302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b10b9-ee79-4698-a8cf-d6f09164d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:54.836696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b10b9-ee79-4698-a8cf-d6f09164d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:54.907608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:54.909651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:54.913546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8b6b10b9-ee79-4698-a8cf-d6f09164d3b1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:54.918716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8b6b10b9-ee79-4698-a8cf-d6f09164d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:54.941489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:55.125853 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 861/1705] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:55.136954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.139802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.142408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.203616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff87169-d6d2-4529-9d7c-505d6bbf751f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.211409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.213116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.213884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.214330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] PATH_INFO: `/v3/users/9a54d0166c27450f99507793483542ff` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.223729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:55.225408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a54d0166c27450f99507793483542ff)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.238971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:55.263738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:55.265017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:55.299726 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 862/1706] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:55.301267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:55.320823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c1e22-565f-4e5b-b994-72184965f0c0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.343238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.343957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.344510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.344792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.353790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:47:55.354752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.360455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:55.363797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a54d0166c27450f99507793483542ff'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:55.372622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a54d0166c27450f99507793483542ff'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:55.373477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a54d0166c27450f99507793483542ff'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:55.388769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a54d0166c27450f99507793483542ff'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:55.404219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a54d0166c27450f99507793483542ff'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:55.411632 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 863/1707] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:47:55.422675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:55.426551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:55.426899 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 845/1708] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:54 2022] DELETE /identity/v3/users/9a54d0166c27450f99507793483542ff => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:47:55.448047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644bb34-8a6f-4f8b-8ef0-91d8bc04dd28 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.550174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.552318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.553066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.553888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.555923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.567094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:55.627930 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 864/1709] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:55 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:55.631901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:55.644123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fe85a-cd33-4948-b5d4-10da5735f102 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.733499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.734249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.734527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.734809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.735581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.739795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:55.784679 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 846/1710] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:55 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:55.786077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:55.799874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a0562-c9fc-4ee5-bacf-eebdeda9bac4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.813988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.814754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.815037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.815385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.816196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.818067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:55.856196 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 865/1711] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:55.857056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:55.875344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706113f-b9f0-4aee-96ee-5acdd1ee73ac admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.883647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019298b3-46b8-4e65-a79f-429c4d46568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.884426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019298b3-46b8-4e65-a79f-429c4d46568d admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.884711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019298b3-46b8-4e65-a79f-429c4d46568d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.885103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019298b3-46b8-4e65-a79f-429c4d46568d admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.885943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019298b3-46b8-4e65-a79f-429c4d46568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.887816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019298b3-46b8-4e65-a79f-429c4d46568d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:55.921758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:55.922831 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 847/1712] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:55.936688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025632c9-3dd8-495f-8415-173e67e6ba6a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:55.950018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:55.951147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:55.951427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:55.951701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] PATH_INFO: `/v3/projects/159416e7759a4add8fa0a8dbd6296ad6/users/61be98700cad486b83e837fac6a28f53/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:55.989841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159416e7759a4add8fa0a8dbd6296ad6, user_id=61be98700cad486b83e837fac6a28f53, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:55.993091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:56.044969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:56.045240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:56.045363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:56.047194 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 866/1713] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:55 2022] PUT /identity/v3/projects/159416e7759a4add8fa0a8dbd6296ad6/users/61be98700cad486b83e837fac6a28f53/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:47:56.054444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:56.086584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] MFA Rules not processed for user `61be98700cad486b83e837fac6a28f53`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:56.096153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:56.308357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:56.310441 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 848/1714] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:56.314584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:56.318213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:56.558187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee02186-572d-4e97-952d-ecd81b99072d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:56.569005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:56.569919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:56.570277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:56.570629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:56.571415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:56.574405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:56.629585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4de9f-ad6b-4d7b-ba69-9556dce0b263 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:56.638480 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 849/1715] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:47:56 2022] POST /identity/v3/projects => generated 365 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:56.642456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:56.651755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:56.653080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:56.653392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:56.653727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] PATH_INFO: `/v3/projects/ab96ebe1a71849728029f6aef1d28713` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:56.655853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab96ebe1a71849728029f6aef1d28713)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:56.657725 dv-cinder-master-3-smb devstack@keystone.service[90356]: WARNING py.warnings [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:47:56.657725 dv-cinder-master-3-smb devstack@keystone.service[90356]: warnings.warn(msg) May 23 12:47:56.657725 dv-cinder-master-3-smb devstack@keystone.service[90356]: May 23 12:47:56.659445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:56.774443 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:56.783825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652bd2-c306-4de9-97af-82a94aa0bb20 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:56.807599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab96ebe1a71849728029f6aef1d28713', 'request_id': 'req-a1fe8245-6219-47a3-978e-a3bac799041e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:56.816537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab96ebe1a71849728029f6aef1d28713', 'request_id': 'req-a1fe8245-6219-47a3-978e-a3bac799041e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:56.825894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:56.842227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab96ebe1a71849728029f6aef1d28713', 'request_id': 'req-a1fe8245-6219-47a3-978e-a3bac799041e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:56.876954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] The token cache is being invalidate because project ab96ebe1a71849728029f6aef1d28713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:47:56.877657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:56.879298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:56.881447 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 867/1716] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:47:56 2022] DELETE /identity/v3/projects/ab96ebe1a71849728029f6aef1d28713 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:56.893264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:56.894947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:56.910707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:56.912411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:56.912883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:56.913385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:56.914548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:56.917209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:56.924063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8245-6219-47a3-978e-a3bac799041e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:56.932626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:56.935296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:56.936231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:56.937699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] PATH_INFO: `/v3/users/be66b6df13d348adb05462be707c6b72` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:56.940628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be66b6df13d348adb05462be707c6b72)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:56.964662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:57.004746 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 850/1717] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:47:56 2022] POST /identity/v3/users => generated 289 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:47:57.006614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:57.009017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:57.039185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f1e14-f9af-40c2-85ef-5775d5f8181c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:57.056573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:57.097891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be66b6df13d348adb05462be707c6b72'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:57.100991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:57.101504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:57.102205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:57.105938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:57.107634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:57.115461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be66b6df13d348adb05462be707c6b72'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:57.118387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be66b6df13d348adb05462be707c6b72'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:57.150560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be66b6df13d348adb05462be707c6b72'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:57.151377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be66b6df13d348adb05462be707c6b72'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:57.161390 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 851/1718] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:57.165744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:57.168153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:57.194721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beebb6-549e-4bc5-ab1d-078abdab795d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:57.200771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84ee89-4a57-4cd3-be11-ce516da55208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:57.214477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84ee89-4a57-4cd3-be11-ce516da55208 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:57.215308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84ee89-4a57-4cd3-be11-ce516da55208 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:57.215966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84ee89-4a57-4cd3-be11-ce516da55208 admin admin] PATH_INFO: `/v3/projects/23320e4dcfb04b619a41cc9693338941/users/ca2849aec58d44058cff3ab508af57df/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:57.225881 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 868/1719] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:56 2022] DELETE /identity/v3/users/be66b6df13d348adb05462be707c6b72 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:57.258492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:57.260220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:57.298507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84ee89-4a57-4cd3-be11-ce516da55208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23320e4dcfb04b619a41cc9693338941, user_id=ca2849aec58d44058cff3ab508af57df, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:57.301963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84ee89-4a57-4cd3-be11-ce516da55208 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:57.347966 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 852/1720] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:57 2022] PUT /identity/v3/projects/23320e4dcfb04b619a41cc9693338941/users/ca2849aec58d44058cff3ab508af57df/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:47:57.353694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:57.356343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:57.365283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:57.453498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] MFA Rules not processed for user `d23ca857b76540ce83053424b710697b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:57.454785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:57.563955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd637b-3b86-4b69-b6b9-7dfa92acbc0a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:57.664747 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 853/1721] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:57.668089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:57.674711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:57.766475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:57.824564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:57.825678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:57.825966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:57.826246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] PATH_INFO: `/v3/projects/c7b8ddc7110b42a1a9d236ace4a93ae0` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:57.831579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b8ddc7110b42a1a9d236ace4a93ae0)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:57.837889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:57.919718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fb55b-07b3-41a5-8fe1-76bef218f9c3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:57.928440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:57.929543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:57.929900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:57.930246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] PATH_INFO: `/v3/projects/b0f9c2c88e8c4039ab7bbfaae428a44c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:57.933113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f9c2c88e8c4039ab7bbfaae428a44c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:57.936700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:57.969645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:58.103681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b8ddc7110b42a1a9d236ace4a93ae0', 'request_id': 'req-514c3456-495a-48d5-be74-2a37ba0becbb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.135135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b8ddc7110b42a1a9d236ace4a93ae0', 'request_id': 'req-514c3456-495a-48d5-be74-2a37ba0becbb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.139968 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f9c2c88e8c4039ab7bbfaae428a44c', 'request_id': 'req-9c140773-0a42-421d-8f79-0af4ecfbf677'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.163956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b8ddc7110b42a1a9d236ace4a93ae0', 'request_id': 'req-514c3456-495a-48d5-be74-2a37ba0becbb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.173393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f9c2c88e8c4039ab7bbfaae428a44c', 'request_id': 'req-9c140773-0a42-421d-8f79-0af4ecfbf677'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.190137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] The token cache is being invalidate because project c7b8ddc7110b42a1a9d236ace4a93ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:47:58.191751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f9c2c88e8c4039ab7bbfaae428a44c', 'request_id': 'req-9c140773-0a42-421d-8f79-0af4ecfbf677'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.192271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.193881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.200358 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 869/1722] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:47:57 2022] DELETE /identity/v3/projects/c7b8ddc7110b42a1a9d236ace4a93ae0 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:58.201474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:58.211023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:58.236243 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] The token cache is being invalidate because project b0f9c2c88e8c4039ab7bbfaae428a44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:47:58.237541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.241844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.246580 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 854/1723] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:47:57 2022] DELETE /identity/v3/projects/b0f9c2c88e8c4039ab7bbfaae428a44c => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:58.248316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:58.260294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:58.468701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3456-495a-48d5-be74-2a37ba0becbb admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:58.534045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140773-0a42-421d-8f79-0af4ecfbf677 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:58.558080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:58.560419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:58.560924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:58.562657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:58.566913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:58.628593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:58.629617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:58.629965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:58.630348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:58.631150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:58.633003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:58.669261 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 870/1724] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:47:58.670282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:58.674822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:58.704842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac554a-2a90-4f80-869d-f5ccbc0ff5d6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:58.715176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:58.716293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:58.716581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:58.716866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] PATH_INFO: `/v3/users/bb52a51a0180408dae1fba29f252873a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:58.718575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb52a51a0180408dae1fba29f252873a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:58.720801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:58.729103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:58.735288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:58.762454 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 855/1725] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:47:58.762694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:58.763278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:58.765427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:58.825321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507118ed-e1d3-4cc3-9eae-416640971473 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:58.837924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb52a51a0180408dae1fba29f252873a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.854151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:58.855110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:58.855688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:58.855688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] PATH_INFO: `/v3/users/f25786e3d2094c5ca8efdf165691b5a3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:58.858461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25786e3d2094c5ca8efdf165691b5a3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:58.860491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb52a51a0180408dae1fba29f252873a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.860652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:58.862133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb52a51a0180408dae1fba29f252873a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.881737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb52a51a0180408dae1fba29f252873a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.884919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb52a51a0180408dae1fba29f252873a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.947833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:58.978030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25786e3d2094c5ca8efdf165691b5a3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:58.984837 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 871/1726] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:58 2022] DELETE /identity/v3/users/bb52a51a0180408dae1fba29f252873a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:58.994622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:58.997612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:59.024314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25786e3d2094c5ca8efdf165691b5a3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.025775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25786e3d2094c5ca8efdf165691b5a3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.079872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25786e3d2094c5ca8efdf165691b5a3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.103421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6f8f2ebb-2dc5-4672-b997-a844901f98ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25786e3d2094c5ca8efdf165691b5a3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.118830 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 856/1727] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:47:58 2022] DELETE /identity/v3/users/f25786e3d2094c5ca8efdf165691b5a3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:59.125277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a014b-9e29-4d0d-bd8d-13b6b93e9418 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:59.127286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a014b-9e29-4d0d-bd8d-13b6b93e9418 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:59.128697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a014b-9e29-4d0d-bd8d-13b6b93e9418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:59.148729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5502-aec5-47ae-aa4a-42d23a01d334 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:59.209948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8d3a014b-9e29-4d0d-bd8d-13b6b93e9418 None None] MFA Rules not processed for user `2335faffe08d4c75ab85aa124819c513`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:59.212817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8d3a014b-9e29-4d0d-bd8d-13b6b93e9418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:59.329118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:59.330418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:59.330845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:59.331225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] PATH_INFO: `/v3/projects/23320e4dcfb04b619a41cc9693338941/users/ca2849aec58d44058cff3ab508af57df/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:59.335688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23320e4dcfb04b619a41cc9693338941, user_id=ca2849aec58d44058cff3ab508af57df, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:59.340549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:59.359997 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 872/1728] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:47:58 2022] PUT /identity/v3/projects/23320e4dcfb04b619a41cc9693338941/users/ca2849aec58d44058cff3ab508af57df/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:59.370764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:59.370764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:59.420782 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 857/1729] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:59.420782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:59.420782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:59.420782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:59.439960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:59.494161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] MFA Rules not processed for user `ca2849aec58d44058cff3ab508af57df`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:47:59.497015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:59.515430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d067dc-d9d8-42d8-95fa-6f98d4adda68 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:47:59.525078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:47:59.526578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:47:59.529634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:47:59.530099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] PATH_INFO: `/v3/projects/ab6454bc43064654a95311cdc609cfe2` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:47:59.537941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6454bc43064654a95311cdc609cfe2)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:47:59.542559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:47:59.703109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6454bc43064654a95311cdc609cfe2', 'request_id': 'req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.728223 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 858/1730] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:47:59.729680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:59.734707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:59.744251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6454bc43064654a95311cdc609cfe2', 'request_id': 'req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.775738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6454bc43064654a95311cdc609cfe2', 'request_id': 'req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.819879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] The token cache is being invalidate because project ab6454bc43064654a95311cdc609cfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:47:59.822881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.828094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:47:59.840491 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 873/1731] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:47:59 2022] DELETE /identity/v3/projects/ab6454bc43064654a95311cdc609cfe2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:47:59.840491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:47:59.847356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:47:59.863145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:00.013014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3424b-3f82-4e3d-ac26-de22f9127c84 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:00.072997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff43d8e-53bc-4794-abb3-c7c88dbbfd78 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:00.083764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:00.086776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:00.099098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:00.101342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:00.122515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:00.222396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:00.223277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:00.223672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:00.224427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:00.228247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:00.391764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:00.393286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff3470-0803-494b-804a-69e625837e87 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:00.434108 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 874/1732] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:00.435629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:00.435925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:00.436235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:00.446155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:00.449929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:00.488802 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 859/1733] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:47:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:00.491506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:00.493424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:00.528753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:00.530051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:00.568115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:00.707878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea5cc9-8954-4885-a02a-09d279a5ba56 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:00.723365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:00.727655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:00.727655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:00.727655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] PATH_INFO: `/v3/projects/79ea4ffe4a394c92aec916a4abf19fed` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:00.731762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ea4ffe4a394c92aec916a4abf19fed)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:00.734859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:00.742369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:00.842041 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 875/1734] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:00.845856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:00.862385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ea4ffe4a394c92aec916a4abf19fed', 'request_id': 'req-c31ac93f-b6e4-476f-a520-9f5b6fe32410'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:00.879172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ea4ffe4a394c92aec916a4abf19fed', 'request_id': 'req-c31ac93f-b6e4-476f-a520-9f5b6fe32410'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:00.899954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6edd60-18bb-4acb-86d6-098761c12210 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:00.904988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ea4ffe4a394c92aec916a4abf19fed', 'request_id': 'req-c31ac93f-b6e4-476f-a520-9f5b6fe32410'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:00.929397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] The token cache is being invalidate because project 79ea4ffe4a394c92aec916a4abf19fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:00.929804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:00.933894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c31ac93f-b6e4-476f-a520-9f5b6fe32410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:00.937803 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 860/1735] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:00 2022] DELETE /identity/v3/projects/79ea4ffe4a394c92aec916a4abf19fed => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:00.939097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470a42-8788-49de-b66c-55451debbc12 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:00.939460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470a42-8788-49de-b66c-55451debbc12 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:00.939809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470a42-8788-49de-b66c-55451debbc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:00.998306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-76470a42-8788-49de-b66c-55451debbc12 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:01.000580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-76470a42-8788-49de-b66c-55451debbc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:01.130501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:01.135825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:01.136436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:01.137507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:01.145411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:01.270696 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 861/1736] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:01.271924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:01.272302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:01.272691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:01.371771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:01.378627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:01.432944 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 876/1737] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:01.434415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:01.438787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:01.440264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:01.444102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:01.487115 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 862/1738] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:01.487913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:01.544209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c60ff-e7b3-4f8c-b63b-4684be68d806 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:01.549405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9614f5-b816-4fbf-aba4-8c47dfe3a53c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:01.570992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:01.571937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:01.572242 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:01.572567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:01.574461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:01.574833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:01.576560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1b2a5-7fe6-4974-987f-9c19aca0fafa admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:01.576683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:01.583317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:01.583317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:01.583317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] PATH_INFO: `/v3/projects/c5632f0d3a0f47779b144a0bf2d9ca70` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:01.595617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5632f0d3a0f47779b144a0bf2d9ca70)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:01.602929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:01.635825 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 863/1739] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:01.648035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a381-c4de-48e0-b389-5a49ea0c8632 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:01.652183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a381-c4de-48e0-b389-5a49ea0c8632 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:01.655519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a381-c4de-48e0-b389-5a49ea0c8632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:01.724945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b0d1a381-c4de-48e0-b389-5a49ea0c8632 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:01.726440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b0d1a381-c4de-48e0-b389-5a49ea0c8632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:01.736782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5632f0d3a0f47779b144a0bf2d9ca70', 'request_id': 'req-435dfb5e-cfc2-4266-95d1-9b3622f06598'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:01.776286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5632f0d3a0f47779b144a0bf2d9ca70', 'request_id': 'req-435dfb5e-cfc2-4266-95d1-9b3622f06598'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:01.794185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:01.824212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5632f0d3a0f47779b144a0bf2d9ca70', 'request_id': 'req-435dfb5e-cfc2-4266-95d1-9b3622f06598'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:01.864021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] The token cache is being invalidate because project c5632f0d3a0f47779b144a0bf2d9ca70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:01.864710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:01.864793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:01.867712 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 877/1740] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:01 2022] DELETE /identity/v3/projects/c5632f0d3a0f47779b144a0bf2d9ca70 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:01.868888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:01.873377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:02.057708 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 864/1741] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:02.059720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.060016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.060301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.082581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:02.083974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:02.098211 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 865/1742] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:02.099359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.125314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:02.129425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dfb5e-cfc2-4266-95d1-9b3622f06598 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.133930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779eb3-0758-46d9-9712-89f5df119c53 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.141819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.142618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.145235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.145550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.148686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.151100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.156995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.158114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.158405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.158689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.159818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:02.160843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.162516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56f59-64a0-4b0e-90fa-739d04a2e656 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.205293 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 866/1743] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:02.208684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.209536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.212710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.220839 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 878/1744] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:01 2022] POST /identity/v3/projects => generated 385 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:02.221786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.260003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:02.261993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:02.396878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10e48-64fd-410f-a174-98dd927c7407 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.414071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.414873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.415084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.415365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.416146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.418199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.421454 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 867/1745] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:02.422454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.449256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb437-8d26-41de-b028-2017ffa56656 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.472184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.473667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.474053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.474409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.475363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.477844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.508328 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 879/1746] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:02 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:02.509425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.522371 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 868/1747] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:02 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:02.523639 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.547857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb074b-7960-48f4-aa56-b8313ed0dec0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.678232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95f58-bbd3-4a2a-9124-2268c4e48044 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.683814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.685211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.685741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.686193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.687132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:02.687617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.689618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.692553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:02.705503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.706199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.706479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.706852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.713039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.717963 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 880/1748] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:02.717963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.718212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.736970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d16c52-dbba-4104-ab4b-b01c9bae66d1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.755036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.756083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.756909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.757529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.758589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.762331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.773426 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 869/1749] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:02 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:02.773426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.801078 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 881/1750] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:02.805531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.814127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017e49-63f3-47cd-a277-4e2002f675b0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.827741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.828756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.829124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc7b6e-30cd-459b-a850-61474fea45fd admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:02.829251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.829604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.830566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.835985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.843099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:02.843915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:02.844654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:02.845032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:02.846561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:02.850321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:02.884269 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 882/1751] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:02.885428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.896738 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 870/1752] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:02 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:02.897826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:02.912973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4efbc-0691-4beb-83f4-42507d36b046 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.080629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.084063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.086076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.087874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.090372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.093425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:03.095775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.144959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538e9b-4ebe-4b73-a980-4641cd41d41f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.148538 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 883/1753] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:03.150257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:03.158254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.159045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.159407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.159760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.160587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.166228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.181313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3513-4d50-444b-8a0d-f249577e1b90 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.193180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.194238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.196351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.197091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.199387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.202069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.204064 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 871/1754] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:03.216711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:03.242861 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 884/1755] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:03 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:03.244252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:03.252698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc22a8-a1cf-47cf-aa8b-42136b578f6c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.267328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f9bb-025b-4a22-a617-541a841f52be admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.269174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.270034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.270338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.270601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] PATH_INFO: `/v3/projects/1984e1f203bc4ffca8d678d386a4f6c9/users/4ec1316a68024387835adb8ac3cf930b/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.285201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.286295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.286713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.287091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] PATH_INFO: `/v3/projects/ac57e74b76b14130bfe8f607ce7134a8/users/31287ccaddc94788bb24f11f4f6261ba/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.321170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1984e1f203bc4ffca8d678d386a4f6c9, user_id=4ec1316a68024387835adb8ac3cf930b, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.334546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.383868 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 872/1756] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:03 2022] PUT /identity/v3/projects/1984e1f203bc4ffca8d678d386a4f6c9/users/4ec1316a68024387835adb8ac3cf930b/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:03.383868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:03.581991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba88eb3-9867-471c-af3d-0387adcd9fe7 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.588722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a6057-7f0e-4795-9314-c7e2d5391be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.590188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a6057-7f0e-4795-9314-c7e2d5391be0 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.590633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a6057-7f0e-4795-9314-c7e2d5391be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.591058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a6057-7f0e-4795-9314-c7e2d5391be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.592390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a6057-7f0e-4795-9314-c7e2d5391be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.595410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a6057-7f0e-4795-9314-c7e2d5391be0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.617978 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 873/1757] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:03.623518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee803629-fbd0-49eb-9a32-fed71e85ca24 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.624034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee803629-fbd0-49eb-9a32-fed71e85ca24 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.624628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee803629-fbd0-49eb-9a32-fed71e85ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.684593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ee803629-fbd0-49eb-9a32-fed71e85ca24 None None] MFA Rules not processed for user `4ec1316a68024387835adb8ac3cf930b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:03.686941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ee803629-fbd0-49eb-9a32-fed71e85ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:03.732207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac57e74b76b14130bfe8f607ce7134a8, user_id=31287ccaddc94788bb24f11f4f6261ba, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.735125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.772258 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 885/1758] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:03 2022] PUT /identity/v3/projects/ac57e74b76b14130bfe8f607ce7134a8/users/31287ccaddc94788bb24f11f4f6261ba/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:03.775123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:03.799140 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 874/1759] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:03.809652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.810440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.821462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.873132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9672b-9aa3-4c78-9c78-599c3f8af228 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.880201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.881003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.881394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.881786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.882638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.884588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.911481 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 886/1760] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:03.912455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:03.914900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] MFA Rules not processed for user `31287ccaddc94788bb24f11f4f6261ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:03.916351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:03.936877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347798e-2393-4f42-a0f0-81729523fd51 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:03.950551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:03.952870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:03.953952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:03.954611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:03.957469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:03.962521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:03.999575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:04.012655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:04.027529 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 887/1761] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:03 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:04.030100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.085508 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 875/1762] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:04.086652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.101106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a07d-8963-4dea-bd82-5292e0cae7f8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.179276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e8c1-a707-4075-a59a-c9c8c9d46d26 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.183870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.184806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.185174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.185653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.187131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.191529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.193486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.194452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.194737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.195137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] PATH_INFO: `/v3/projects/25bf285d9efe436f84ef0c65b73defc5/users/5e69ccd63613433c8912a000c6f89bb2/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.231367 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 876/1763] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:04.231974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bf285d9efe436f84ef0c65b73defc5, user_id=5e69ccd63613433c8912a000c6f89bb2, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.232412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.235074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.244183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c6cc9-0b5e-401f-b6ee-6a6ed7e12a0a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.251239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134a560-dc88-4b44-964d-75e29481182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.252114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a560-dc88-4b44-964d-75e29481182e admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.252225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a560-dc88-4b44-964d-75e29481182e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.252465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a560-dc88-4b44-964d-75e29481182e admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.253160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134a560-dc88-4b44-964d-75e29481182e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.255704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134a560-dc88-4b44-964d-75e29481182e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.272498 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 888/1764] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:04 2022] PUT /identity/v3/projects/25bf285d9efe436f84ef0c65b73defc5/users/5e69ccd63613433c8912a000c6f89bb2/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:04.273754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.298779 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 877/1765] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:04.300228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70934b6-3b1d-4fdb-8bcf-4eb0ad39dc8e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.301067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70934b6-3b1d-4fdb-8bcf-4eb0ad39dc8e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.301378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70934b6-3b1d-4fdb-8bcf-4eb0ad39dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.359887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d89cd6-ccd6-4226-957b-4e46dcd41ad6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.364070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a70934b6-3b1d-4fdb-8bcf-4eb0ad39dc8e None None] MFA Rules not processed for user `5e69ccd63613433c8912a000c6f89bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:04.368018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a70934b6-3b1d-4fdb-8bcf-4eb0ad39dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:04.445108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.445958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.446314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.447817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.452515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.455390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.477567 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 889/1766] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:04.478455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.491574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c2fb-bfd1-47c3-b696-9408c1be784b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.499110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.501851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.502364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.503063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.504484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.507029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.521359 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 878/1767] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:04.522453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.523211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.523503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.543013 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 890/1768] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/users => generated 290 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:04.544720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.558866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] MFA Rules not processed for user `d23ca857b76540ce83053424b710697b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:04.560277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:04.576014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c93b-6707-4073-b92e-b8e2f4bc4031 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.587306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.588405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.588683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.589082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] PATH_INFO: `/v3/projects/b0b63c3f28bc475081299f1d0adad4a8/users/27a801cf3f934039833679b440ae999f/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.598128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:04.608163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:04.647612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b63c3f28bc475081299f1d0adad4a8, user_id=27a801cf3f934039833679b440ae999f, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.650040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.675607 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 891/1769] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:04 2022] PUT /identity/v3/projects/b0b63c3f28bc475081299f1d0adad4a8/users/27a801cf3f934039833679b440ae999f/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:04.677280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.717972 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 879/1770] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:04.717972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.741403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8a7a-74ae-4d75-bdc8-8b7972b9e55f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.832649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.833928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.834435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.838210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.839152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.849547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d55e54-3435-4a7c-bba6-3f5b99448d29 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.853312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.863436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a2ab-0692-41b0-9e96-f64e789e5e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.864240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a2ab-0692-41b0-9e96-f64e789e5e65 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.864536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a2ab-0692-41b0-9e96-f64e789e5e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.864855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a2ab-0692-41b0-9e96-f64e789e5e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.865589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a2ab-0692-41b0-9e96-f64e789e5e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.873309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a2ab-0692-41b0-9e96-f64e789e5e65 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.881008 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 880/1771] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:04.881962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.906321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624002b-c401-403b-82fd-aa928741a9fe admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:04.916252 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 892/1772] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:04.920245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.920805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.921455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.929067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:04.930005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:04.930441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:04.930920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:04.931815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:04.934851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:04.950832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] MFA Rules not processed for user `2335faffe08d4c75ab85aa124819c513`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:04.952136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:04.967018 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 881/1773] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:04.982250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:04.998470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9cad0-79a3-48df-aa41-927edd40519e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.054514 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 893/1774] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:05.055592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.144831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.145970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.146311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.146747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] PATH_INFO: `/v3/projects/55f884e1a92d431493d61d5425536146/users/8a24391cca724996a8b720d3b314fda0/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.189422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f884e1a92d431493d61d5425536146, user_id=8a24391cca724996a8b720d3b314fda0, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.193568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.224487 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 882/1775] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:04 2022] PUT /identity/v3/projects/55f884e1a92d431493d61d5425536146/users/8a24391cca724996a8b720d3b314fda0/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:05.225570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.226896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c521cf-1fed-4437-bb21-dabe1e8b6c44 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.288239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:05.341413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:05.400399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41052-6884-43d8-8b4d-749537eb258e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.411063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e5af1-64ec-48a0-bb73-23c67caab074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.411746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e5af1-64ec-48a0-bb73-23c67caab074 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.412024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e5af1-64ec-48a0-bb73-23c67caab074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.412299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e5af1-64ec-48a0-bb73-23c67caab074 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.413498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.414441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.414656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.414927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] PATH_INFO: `/v3/projects/b0b63c3f28bc475081299f1d0adad4a8/users/27a801cf3f934039833679b440ae999f/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.416284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e5af1-64ec-48a0-bb73-23c67caab074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.419062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b63c3f28bc475081299f1d0adad4a8, user_id=27a801cf3f934039833679b440ae999f, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.423190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e5af1-64ec-48a0-bb73-23c67caab074 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.428639 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.461675 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 883/1776] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:05 2022] PUT /identity/v3/projects/b0b63c3f28bc475081299f1d0adad4a8/users/27a801cf3f934039833679b440ae999f/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:05.466197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.480980 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 894/1777] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:05 2022] POST /identity/v3/users => generated 289 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:05.480980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.480980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.483081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.563981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] MFA Rules not processed for user `27a801cf3f934039833679b440ae999f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:05.566188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:05.627608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e94bf-489e-401c-9259-613472af9322 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.640704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.641596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.641723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.641969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.643090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.644719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.672704 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 884/1778] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:05.673633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.693061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c55a-c572-4b92-afe7-1f9a108eb2c4 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.700006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.700879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.701374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.702157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.703078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.704876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.716662 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 895/1779] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:05.716662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.726668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77c5d-1255-4404-9dab-d23632e58d16 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.734550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.737249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.737249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.737249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] PATH_INFO: `/v3/projects/55f884e1a92d431493d61d5425536146/users/8a24391cca724996a8b720d3b314fda0/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.738926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f884e1a92d431493d61d5425536146, user_id=8a24391cca724996a8b720d3b314fda0, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.741175 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 885/1780] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:05.743323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.744823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.751031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:05.759214 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 896/1781] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:05 2022] PUT /identity/v3/projects/55f884e1a92d431493d61d5425536146/users/8a24391cca724996a8b720d3b314fda0/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:05.760200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:05.875972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f9a38-96a1-4f6d-b5ea-0d2118dde79b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.887135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c51d-6275-4337-8668-5ef1254a4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:05.888042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c51d-6275-4337-8668-5ef1254a4185 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.893315 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eee48-6506-4d95-a866-bfc96a4360a0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:05.898599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c51d-6275-4337-8668-5ef1254a4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.898753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c51d-6275-4337-8668-5ef1254a4185 admin admin] PATH_INFO: `/v3/projects/3241bf177c2045c2b315c07faaa3bfe2/users/b27d2e18834a4cae8f4d8f46fd45b22e/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:05.940472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c51d-6275-4337-8668-5ef1254a4185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3241bf177c2045c2b315c07faaa3bfe2, user_id=b27d2e18834a4cae8f4d8f46fd45b22e, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:05.947938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c51d-6275-4337-8668-5ef1254a4185 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:05.979228 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 897/1782] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:05 2022] PUT /identity/v3/projects/3241bf177c2045c2b315c07faaa3bfe2/users/b27d2e18834a4cae8f4d8f46fd45b22e/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:05.984851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae267334-65b3-45b5-8c4c-d6ec6b3a444d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:05.985403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae267334-65b3-45b5-8c4c-d6ec6b3a444d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:05.991456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae267334-65b3-45b5-8c4c-d6ec6b3a444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.008346 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:06.009710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.010050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.011919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.021764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:06.056132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ae267334-65b3-45b5-8c4c-d6ec6b3a444d None None] MFA Rules not processed for user `8a24391cca724996a8b720d3b314fda0`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:06.066062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ae267334-65b3-45b5-8c4c-d6ec6b3a444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.101325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:06.189376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:06.190869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:06.220588 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 886/1783] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:06.222332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:06.234548 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 898/1784] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:06.237043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb6cf2-d8d2-40a3-b8d9-077278088ce4 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.237690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb6cf2-d8d2-40a3-b8d9-077278088ce4 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.238331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb6cf2-d8d2-40a3-b8d9-077278088ce4 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.245402 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 899/1785] 10.222.0.45 () {54 vars in 912 bytes} [Mon May 23 12:48:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:48:06.249172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.249172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.249549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.282569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dbd0b-ccaf-47ff-aada-d8b89232f652 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:06.287391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:06.289449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.466472 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 900/1786] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:06.467576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:06.484437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:06.485125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.485432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.485720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.487856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:06.491458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:06.519155 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 887/1787] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:06.520249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:06.625948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b8de-8cb4-448c-8184-eb6ba9d6624e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:06.638906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:06.639901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.640179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.640461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] PATH_INFO: `/v3/users/4ec1316a68024387835adb8ac3cf930b` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.644293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec1316a68024387835adb8ac3cf930b)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:06.649342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:06.652658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03c981-4510-4e32-8ec6-5495c8ee08af admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:06.678671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:06.679659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.680119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.680290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.694905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:06.700281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:06.731926 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:06.734476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec1316a68024387835adb8ac3cf930b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:06.736377 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 888/1788] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:06.737405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:06.740752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.752110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec1316a68024387835adb8ac3cf930b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:06.754764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec1316a68024387835adb8ac3cf930b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:06.768677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8c2c9-7698-460c-b0c2-d6b35c420e96 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:06.771219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec1316a68024387835adb8ac3cf930b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:06.772883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec1316a68024387835adb8ac3cf930b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:06.788072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:06.789067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.789452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.789779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.803448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.815687 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 901/1789] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:06 2022] DELETE /identity/v3/users/4ec1316a68024387835adb8ac3cf930b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:06.815687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:06.817044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.825584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:06.829394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d089f-3f7d-4386-84cc-702589e12725 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:06.865021 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 889/1790] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:06.868607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.870265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.870658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.909445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:06.911202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.920579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d31b7-e1c0-4b78-8cae-debdc414af0b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:06.924952 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 890/1791] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:06.931216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78986c-3e5b-4d0b-ae20-aea08e8773d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:06.932458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78986c-3e5b-4d0b-ae20-aea08e8773d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.932458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78986c-3e5b-4d0b-ae20-aea08e8773d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.932864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78986c-3e5b-4d0b-ae20-aea08e8773d2 admin admin] PATH_INFO: `/v3/projects/3241bf177c2045c2b315c07faaa3bfe2/users/b27d2e18834a4cae8f4d8f46fd45b22e/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:06.935160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:06.936786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:06.954455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78986c-3e5b-4d0b-ae20-aea08e8773d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3241bf177c2045c2b315c07faaa3bfe2, user_id=b27d2e18834a4cae8f4d8f46fd45b22e, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:06.961949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78986c-3e5b-4d0b-ae20-aea08e8773d2 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:06.989661 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 902/1792] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:06 2022] PUT /identity/v3/projects/3241bf177c2045c2b315c07faaa3bfe2/users/b27d2e18834a4cae8f4d8f46fd45b22e/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:06.995268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:06.996100 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:06.996653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:07.038332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] MFA Rules not processed for user `b27d2e18834a4cae8f4d8f46fd45b22e`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:07.040580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:07.103880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:07.128650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742c66-5c27-42de-9aa4-c92ab144fb7c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:07.261467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:07.262685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:07.262980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:07.263320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:07.272205 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 903/1793] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:07.304405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:07.308512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:07.409721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:07.461708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdceaf9-4b65-47a6-9f7c-771dacfdc27a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:07.472247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:07.473058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:07.473543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:07.473868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:07.501852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:07.503356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:07.518935 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 904/1794] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:07.544605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:07.549186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:07.599204 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 891/1795] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:08.202497 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:08.204655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:08.223879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdddac3-9597-4933-84b0-96335fd42a7b service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:08.233102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:08.234462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:08.235040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:08.235561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] PATH_INFO: `/v3/projects/1984e1f203bc4ffca8d678d386a4f6c9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:08.237133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1984e1f203bc4ffca8d678d386a4f6c9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:08.239563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:08.344937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1984e1f203bc4ffca8d678d386a4f6c9', 'request_id': 'req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.365246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1984e1f203bc4ffca8d678d386a4f6c9', 'request_id': 'req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.376549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1984e1f203bc4ffca8d678d386a4f6c9', 'request_id': 'req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.402739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] The token cache is being invalidate because project 1984e1f203bc4ffca8d678d386a4f6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:08.403180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.404329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.410375 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 905/1796] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:08 2022] DELETE /identity/v3/projects/1984e1f203bc4ffca8d678d386a4f6c9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:08.416843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:08.426261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aedf7b-3fea-4bee-893d-8357ca682d36 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:08.617720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:08.622422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:08.622800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:08.623092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] PATH_INFO: `/v3/users/27a801cf3f934039833679b440ae999f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:08.629130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a801cf3f934039833679b440ae999f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:08.637891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:08.794714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a801cf3f934039833679b440ae999f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.805592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:08.815854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a801cf3f934039833679b440ae999f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.817322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a801cf3f934039833679b440ae999f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.840686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a801cf3f934039833679b440ae999f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.851545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-49aae0ab-65e7-4951-acbc-9b6ba2025fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a801cf3f934039833679b440ae999f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:08.879554 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 892/1797] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:08 2022] DELETE /identity/v3/users/27a801cf3f934039833679b440ae999f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:09.001398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:09.002806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:09.055805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17bbca-5568-4acb-84f6-c48e0e0c90cc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:09.186086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:09.187032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:09.187248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:09.187530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] PATH_INFO: `/v3/users/5e69ccd63613433c8912a000c6f89bb2` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:09.188800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e69ccd63613433c8912a000c6f89bb2)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:09.191114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:09.303061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e69ccd63613433c8912a000c6f89bb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.320311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e69ccd63613433c8912a000c6f89bb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.324319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e69ccd63613433c8912a000c6f89bb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.360923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e69ccd63613433c8912a000c6f89bb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.361979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e69ccd63613433c8912a000c6f89bb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.372969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:09.398774 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 906/1798] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:08 2022] DELETE /identity/v3/users/5e69ccd63613433c8912a000c6f89bb2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:09.402065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6468-da33-4974-90d6-28079527389e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:09.402775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6468-da33-4974-90d6-28079527389e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:09.403240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6468-da33-4974-90d6-28079527389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:09.442347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a23a6468-da33-4974-90d6-28079527389e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:09.446289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a23a6468-da33-4974-90d6-28079527389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:09.483790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:09.485969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:09.671697 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 893/1799] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:09.673789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a67458-519c-4993-9b7e-346dfc8f515b None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:09.674075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a67458-519c-4993-9b7e-346dfc8f515b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:09.675686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a67458-519c-4993-9b7e-346dfc8f515b None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:09.675794 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 894/1800] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:48:09.685299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8667-8adc-484d-9ec6-54818315013e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:09.702208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a67458-519c-4993-9b7e-346dfc8f515b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:09.703760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-77a67458-519c-4993-9b7e-346dfc8f515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:09.706906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:09.707794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:09.708085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:09.708391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] PATH_INFO: `/v3/projects/b0b63c3f28bc475081299f1d0adad4a8` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:09.710363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b63c3f28bc475081299f1d0adad4a8)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:09.727231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:09.854456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b63c3f28bc475081299f1d0adad4a8', 'request_id': 'req-fb5f04a3-146e-4fc5-aeef-819eca924a36'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.881826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b63c3f28bc475081299f1d0adad4a8', 'request_id': 'req-fb5f04a3-146e-4fc5-aeef-819eca924a36'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.901030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b63c3f28bc475081299f1d0adad4a8', 'request_id': 'req-fb5f04a3-146e-4fc5-aeef-819eca924a36'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.909865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a67458-519c-4993-9b7e-346dfc8f515b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:09.938416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] The token cache is being invalidate because project b0b63c3f28bc475081299f1d0adad4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:09.939051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.939796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fb5f04a3-146e-4fc5-aeef-819eca924a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:09.947987 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 907/1801] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:09 2022] DELETE /identity/v3/projects/b0b63c3f28bc475081299f1d0adad4a8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:09.949601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabab8-39db-4d55-8613-7b2dbd931fa2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:09.949826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabab8-39db-4d55-8613-7b2dbd931fa2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:09.950109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabab8-39db-4d55-8613-7b2dbd931fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:09.974478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-73dabab8-39db-4d55-8613-7b2dbd931fa2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:09.976579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-73dabab8-39db-4d55-8613-7b2dbd931fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.061387 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 908/1802] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:10.068815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efca000-277c-4057-a024-5497b2341964 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.069106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efca000-277c-4057-a024-5497b2341964 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.069418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efca000-277c-4057-a024-5497b2341964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.075813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.076486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.076773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.077062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.081900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.108437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.109932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0cc33-3bb8-40f8-ae15-cc5f449e4ad4 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.112513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8efca000-277c-4057-a024-5497b2341964 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:10.113826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8efca000-277c-4057-a024-5497b2341964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.128986 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 895/1803] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:10.130354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.130650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.130933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.135802 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 909/1804] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:10.141232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efca000-277c-4057-a024-5497b2341964 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.170742 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efca000-277c-4057-a024-5497b2341964 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.190456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.191139 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.195441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.195839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.199248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:10.203751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.207843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.208916 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:10.211625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.214809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:10.238680 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 910/1805] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:48:10.243254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.269271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42050ee-db37-45f6-84f5-7af2aaaab437 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.281291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:10.285046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.286340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.287848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.288095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.289103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.295642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.388114 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 911/1806] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:10 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:10.389050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.401987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.424971 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 896/1807] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:10.426022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.448804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddcc01-293d-4b6d-a265-b96bed4e371d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.542330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42115b-9e7c-42d6-97da-608674175ff4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.549896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.551903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.552328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.552767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] PATH_INFO: `/v3/users/61be98700cad486b83e837fac6a28f53` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.555213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61be98700cad486b83e837fac6a28f53)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.571812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.583794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.584478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.584759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.585034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.585785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.596518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.652998 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 897/1808] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:10 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:10.654014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.656454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.676263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bea8a-ce95-4464-9e1c-0e6d75554a3d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.683862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.685062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.685581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.685695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61be98700cad486b83e837fac6a28f53'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.685856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] PATH_INFO: `/v3/users/31287ccaddc94788bb24f11f4f6261ba` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.687454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31287ccaddc94788bb24f11f4f6261ba)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.691492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.697695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61be98700cad486b83e837fac6a28f53'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.699063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61be98700cad486b83e837fac6a28f53'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.711218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61be98700cad486b83e837fac6a28f53'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.712324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61be98700cad486b83e837fac6a28f53'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.741409 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 912/1809] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:10 2022] DELETE /identity/v3/users/61be98700cad486b83e837fac6a28f53 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:10.742194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.743662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.772852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31287ccaddc94788bb24f11f4f6261ba'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.783666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31287ccaddc94788bb24f11f4f6261ba'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.784439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31287ccaddc94788bb24f11f4f6261ba'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.803433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31287ccaddc94788bb24f11f4f6261ba'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.814089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31287ccaddc94788bb24f11f4f6261ba'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:10.821483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:10.829712 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 898/1810] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:10 2022] DELETE /identity/v3/users/31287ccaddc94788bb24f11f4f6261ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:10.830840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:10.833050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:10.857332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb60b-70af-4459-961b-7a09ec516b6b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.867507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:10.926666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc243518-7b46-4714-b743-3a65674bf038 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:10.939212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fad977-9c6e-469a-b169-b58dda56c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:10.940896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad977-9c6e-469a-b169-b58dda56c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.946104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad977-9c6e-469a-b169-b58dda56c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.946665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad977-9c6e-469a-b169-b58dda56c8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:10.950852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fad977-9c6e-469a-b169-b58dda56c8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:10.956090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fad977-9c6e-469a-b169-b58dda56c8f9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:10.993336 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 899/1811] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:10.993336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:10.993336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:10.993336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.003330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:11.004009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.004294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.004577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.007137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:11.020804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:11.022860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922a415-7def-4d08-adc3-a6071cbda439 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:11.035568 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 913/1812] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:11.037016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.037414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.037639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.059551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:11.068789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:11.073773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:11.077974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:11.091374 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 914/1813] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:11.092540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:11.107982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd550-b7dd-47ba-9efe-6a988c47f1a4 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:11.110161 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 900/1814] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:11.117155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:11.118489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.119024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.119553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.120819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:11.123400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:11.139557 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 915/1815] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:11.140569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:11.142810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:11.146040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:11.180813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc6e6b-b074-49c6-86a2-9989ec14e718 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:11.198414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:11.200675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.201199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.201657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] PATH_INFO: `/v3/projects/643c819ddcb24badb83acd2c063e1bdd/users/14383606ccc14a2f83ca46a5d9034823/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.299090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643c819ddcb24badb83acd2c063e1bdd, user_id=14383606ccc14a2f83ca46a5d9034823, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:11.305817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:11.365567 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 916/1816] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:11 2022] PUT /identity/v3/projects/643c819ddcb24badb83acd2c063e1bdd/users/14383606ccc14a2f83ca46a5d9034823/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:11.367512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:11.372847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:11.456715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160419db-7711-4fea-977e-24bfff915ac6 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:11.605708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fc3a5-7d7c-4d46-8de6-ed039ce2e3b8 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:11.622115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dd160-1a5f-4aa2-94a2-7b1dc5cce9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:11.624857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd160-1a5f-4aa2-94a2-7b1dc5cce9eb service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.625458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd160-1a5f-4aa2-94a2-7b1dc5cce9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.625964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd160-1a5f-4aa2-94a2-7b1dc5cce9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.681252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:11.683731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.689811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.691744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.786177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:11.844915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dd160-1a5f-4aa2-94a2-7b1dc5cce9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:11.849416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dd160-1a5f-4aa2-94a2-7b1dc5cce9eb service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:11.873233 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 917/1817] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:11.874728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:11.875044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:11.875267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:11.920870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:11.923656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:11.938193 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 901/1818] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:11.958679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] MFA Rules not processed for user `14383606ccc14a2f83ca46a5d9034823`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:11.960246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:12.057682 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 918/1819] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:12.063144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.079860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f817-5639-4a63-aeb9-ecc2cf776c11 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.094615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.095472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.096337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.096789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.097648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.100507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.121112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:12.140963 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 902/1820] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:12 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:12.144692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.158925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a872-27f7-49c0-8394-7e9f8f4c1cf1 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.237067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.238055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.238505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.238932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.239832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.242649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.266045 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 919/1821] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:12 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:12.270227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.282153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041a78-2e11-4490-a005-d7d5d7cfd664 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.288466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.289264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.289637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.289981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.290786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.293502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.300144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.302491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:12.312644 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 903/1822] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:12.313723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.317778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5eb53-fa02-4576-a081-675ac320a1ad admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.324301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.324828 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5283c-8ba7-4c7a-802a-56deb1b2aa67 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.325492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.325831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.326169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] PATH_INFO: `/v3/projects/25bf285d9efe436f84ef0c65b73defc5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.329220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bf285d9efe436f84ef0c65b73defc5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.332528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.332668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.332668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.332668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.332668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] PATH_INFO: `/v3/projects/64a8ccdbcb454969ac88b2ea06d539ac/users/ba0b4a4d760a496b800643a82f7c16db/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.358925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a8ccdbcb454969ac88b2ea06d539ac, user_id=ba0b4a4d760a496b800643a82f7c16db, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.362890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.389453 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 904/1823] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:12 2022] PUT /identity/v3/projects/64a8ccdbcb454969ac88b2ea06d539ac/users/ba0b4a4d760a496b800643a82f7c16db/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:12.392211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.405482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bf285d9efe436f84ef0c65b73defc5', 'request_id': 'req-65ca9683-c18c-43a3-bf58-1091846c1508'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.415059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bf285d9efe436f84ef0c65b73defc5', 'request_id': 'req-65ca9683-c18c-43a3-bf58-1091846c1508'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.416461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:12.438883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bf285d9efe436f84ef0c65b73defc5', 'request_id': 'req-65ca9683-c18c-43a3-bf58-1091846c1508'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.460560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] The token cache is being invalidate because project 25bf285d9efe436f84ef0c65b73defc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:12.460859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.462637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.470549 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 920/1824] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:12 2022] DELETE /identity/v3/projects/25bf285d9efe436f84ef0c65b73defc5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:12.472318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.473663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:12.531434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4989-1edf-4b5c-bc76-072297f0b25d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.655420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca9683-c18c-43a3-bf58-1091846c1508 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.661563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.662572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.662850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.663213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] PATH_INFO: `/v3/users/b27d2e18834a4cae8f4d8f46fd45b22e` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.665477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27d2e18834a4cae8f4d8f46fd45b22e)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.669288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.696117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.698049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.700891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.701352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.702308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.707630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.747949 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 905/1825] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:12.751401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.754550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:12.774274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c2eb-fe61-4c8f-b2c3-41b24037d822 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:12.782594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27d2e18834a4cae8f4d8f46fd45b22e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.791891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27d2e18834a4cae8f4d8f46fd45b22e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.793402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27d2e18834a4cae8f4d8f46fd45b22e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.800509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41f9d-ae0c-43c9-bf72-e522cca26071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:12.802599 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41f9d-ae0c-43c9-bf72-e522cca26071 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.803050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41f9d-ae0c-43c9-bf72-e522cca26071 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.803305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27d2e18834a4cae8f4d8f46fd45b22e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.803650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41f9d-ae0c-43c9-bf72-e522cca26071 admin admin] PATH_INFO: `/v3/projects/64a8ccdbcb454969ac88b2ea06d539ac/users/ba0b4a4d760a496b800643a82f7c16db/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.803941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27d2e18834a4cae8f4d8f46fd45b22e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:12.806075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41f9d-ae0c-43c9-bf72-e522cca26071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a8ccdbcb454969ac88b2ea06d539ac, user_id=ba0b4a4d760a496b800643a82f7c16db, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:12.808970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41f9d-ae0c-43c9-bf72-e522cca26071 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:12.831821 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 906/1826] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:12 2022] PUT /identity/v3/projects/64a8ccdbcb454969ac88b2ea06d539ac/users/ba0b4a4d760a496b800643a82f7c16db/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:12.834881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:12.835216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:12.835934 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:12.843190 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 921/1827] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:12 2022] DELETE /identity/v3/users/b27d2e18834a4cae8f4d8f46fd45b22e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:12.894602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] MFA Rules not processed for user `ba0b4a4d760a496b800643a82f7c16db`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:12.897068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:12.902203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:12.903679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.031624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96576bee-8971-4462-89d5-52e4c610f3ab admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.036236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:13.051373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.052258 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.052543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.052821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] PATH_INFO: `/v3/projects/ac57e74b76b14130bfe8f607ce7134a8` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.054088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac57e74b76b14130bfe8f607ce7134a8)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:13.056240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:13.080654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:13.115886 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 907/1828] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:13.123986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:13.125795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.155879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53509-a8da-4b91-9fee-5a746c8d519e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.174153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac57e74b76b14130bfe8f607ce7134a8', 'request_id': 'req-8d8f33d1-df16-44e6-b468-dc51cea964b8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.194023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac57e74b76b14130bfe8f607ce7134a8', 'request_id': 'req-8d8f33d1-df16-44e6-b468-dc51cea964b8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.204796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac57e74b76b14130bfe8f607ce7134a8', 'request_id': 'req-8d8f33d1-df16-44e6-b468-dc51cea964b8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.225392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.226984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.227598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.228204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] PATH_INFO: `/v3/projects/159416e7759a4add8fa0a8dbd6296ad6` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.230797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=159416e7759a4add8fa0a8dbd6296ad6)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:13.234249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:13.234741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] The token cache is being invalidate because project ac57e74b76b14130bfe8f607ce7134a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:13.235079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.236160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.243319 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 922/1829] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:12 2022] DELETE /identity/v3/projects/ac57e74b76b14130bfe8f607ce7134a8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:13.244321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:13.247021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.315909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159416e7759a4add8fa0a8dbd6296ad6', 'request_id': 'req-4301b27b-4f3f-41e8-9a06-157104941b02'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.328068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159416e7759a4add8fa0a8dbd6296ad6', 'request_id': 'req-4301b27b-4f3f-41e8-9a06-157104941b02'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.337073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159416e7759a4add8fa0a8dbd6296ad6', 'request_id': 'req-4301b27b-4f3f-41e8-9a06-157104941b02'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.351301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f33d1-df16-44e6-b468-dc51cea964b8 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.362815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] The token cache is being invalidate because project 159416e7759a4add8fa0a8dbd6296ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:13.363112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.363998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.366068 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 908/1830] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:13 2022] DELETE /identity/v3/projects/159416e7759a4add8fa0a8dbd6296ad6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:13.367203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:13.368787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.451601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301b27b-4f3f-41e8-9a06-157104941b02 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.459338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.460601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.460892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.461508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] PATH_INFO: `/v3/users/8a24391cca724996a8b720d3b314fda0` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.462993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a24391cca724996a8b720d3b314fda0)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:13.467171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:13.476719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:13.507967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.509194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.509554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.509880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.513368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.547514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a24391cca724996a8b720d3b314fda0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.556297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a24391cca724996a8b720d3b314fda0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.557060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a24391cca724996a8b720d3b314fda0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.573853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a24391cca724996a8b720d3b314fda0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.590502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a24391cca724996a8b720d3b314fda0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.601188 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 909/1831] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:13 2022] DELETE /identity/v3/users/8a24391cca724996a8b720d3b314fda0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:13.602630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:13.605963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.623342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:13.625355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:13.643953 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 923/1832] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:13.701449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3a47-1c33-4f4d-a5dd-cdf7389f2659 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.706452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.707392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.707678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.707959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] PATH_INFO: `/v3/users/ca2849aec58d44058cff3ab508af57df` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.712589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:13.714726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2849aec58d44058cff3ab508af57df)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:13.720251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.720355 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:13.731006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:13.739679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5633fec-339c-4c1b-b806-0e99fbab6f40 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.778491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.780714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.781003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.781408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] PATH_INFO: `/v3/projects/3241bf177c2045c2b315c07faaa3bfe2` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.783960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3241bf177c2045c2b315c07faaa3bfe2)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:13.786903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:13.817485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2849aec58d44058cff3ab508af57df'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.830593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2849aec58d44058cff3ab508af57df'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.832909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2849aec58d44058cff3ab508af57df'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.850270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2849aec58d44058cff3ab508af57df'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.859058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3241bf177c2045c2b315c07faaa3bfe2', 'request_id': 'req-b535f015-af8e-4c74-82a6-f5a80b583f45'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.863227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2849aec58d44058cff3ab508af57df'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.868205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3241bf177c2045c2b315c07faaa3bfe2', 'request_id': 'req-b535f015-af8e-4c74-82a6-f5a80b583f45'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.877544 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 910/1833] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:13 2022] DELETE /identity/v3/users/ca2849aec58d44058cff3ab508af57df => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:13.879094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:13.879546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3241bf177c2045c2b315c07faaa3bfe2', 'request_id': 'req-b535f015-af8e-4c74-82a6-f5a80b583f45'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.880563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.898283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:13.903039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] The token cache is being invalidate because project 3241bf177c2045c2b315c07faaa3bfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:13.903292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.904036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b535f015-af8e-4c74-82a6-f5a80b583f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:13.907362 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 924/1834] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:13 2022] DELETE /identity/v3/projects/3241bf177c2045c2b315c07faaa3bfe2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:13.915447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04c8d-a2c2-4ee4-ba1c-a15abe345962 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.915989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04c8d-a2c2-4ee4-ba1c-a15abe345962 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.920585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04c8d-a2c2-4ee4-ba1c-a15abe345962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:13.956799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4be04c8d-a2c2-4ee4-ba1c-a15abe345962 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:13.959147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4be04c8d-a2c2-4ee4-ba1c-a15abe345962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:13.984251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4fc0-ec99-44de-8407-e787593b18d3 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:13.994779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:13.996878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:13.997203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:13.997636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] PATH_INFO: `/v3/users/14383606ccc14a2f83ca46a5d9034823` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.000099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14383606ccc14a2f83ca46a5d9034823)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:14.002727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:14.083288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14383606ccc14a2f83ca46a5d9034823'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.091250 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 925/1835] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:14.107211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.107412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.107697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.115493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14383606ccc14a2f83ca46a5d9034823'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.124280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14383606ccc14a2f83ca46a5d9034823'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.152536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:14.154715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:14.154904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14383606ccc14a2f83ca46a5d9034823'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.180223 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 926/1836] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:14.180405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a77a206-98b9-404c-bf78-7296f66a35a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14383606ccc14a2f83ca46a5d9034823'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.186634 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 911/1837] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:13 2022] DELETE /identity/v3/users/14383606ccc14a2f83ca46a5d9034823 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:14.192687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:14.199238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.199496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.199769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.210831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447a29-7c13-4dee-a06c-79a1390d73b0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:14.234532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:14.235634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:14.360724 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 912/1838] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:14.362543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:14.367780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:14.378588 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:14.379383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.379741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.380090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.380903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:14.381314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:14.386326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:14.394462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a30e90-f46f-4951-bc71-9c8a732d5400 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:14.406662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:14.407888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.407888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.408105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] PATH_INFO: `/v3/projects/55f884e1a92d431493d61d5425536146` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.409425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f884e1a92d431493d61d5425536146)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:14.411454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:14.426250 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 927/1839] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:14.428317 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:14.435446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:14.456692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:14.487129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:14.517057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f884e1a92d431493d61d5425536146', 'request_id': 'req-6a6a3390-bec0-4208-8531-e2b3afeaf087'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.532598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f884e1a92d431493d61d5425536146', 'request_id': 'req-6a6a3390-bec0-4208-8531-e2b3afeaf087'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.556390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f884e1a92d431493d61d5425536146', 'request_id': 'req-6a6a3390-bec0-4208-8531-e2b3afeaf087'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.600127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] The token cache is being invalidate because project 55f884e1a92d431493d61d5425536146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:14.602018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.603633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:14.628628 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 913/1840] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:14 2022] DELETE /identity/v3/projects/55f884e1a92d431493d61d5425536146 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:14.638069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6972ee-589e-4ab0-97a0-44a8eb38c399 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:14.639214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:14.643638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:14.758645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:14.762536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.763611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.766233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.775231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:14.833238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3390-bec0-4208-8531-e2b3afeaf087 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:14.870942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295abb6-66c6-4c6a-9e6f-b162c545bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:14.874437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295abb6-66c6-4c6a-9e6f-b162c545bb94 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.877741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295abb6-66c6-4c6a-9e6f-b162c545bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.880837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295abb6-66c6-4c6a-9e6f-b162c545bb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.882841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295abb6-66c6-4c6a-9e6f-b162c545bb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:14.889016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295abb6-66c6-4c6a-9e6f-b162c545bb94 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:14.960497 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 914/1841] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:14 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:14.963479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd6abc-800a-434b-93ba-c69e244727e0 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.964900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd6abc-800a-434b-93ba-c69e244727e0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.965122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd6abc-800a-434b-93ba-c69e244727e0 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:14.978274 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 915/1842] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:48:14 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:48:14.983102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:14.983950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:14.984265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.002141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.008761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.027360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:15.029871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.035154 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 928/1843] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:15.035904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.039389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.063638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d919-bc0d-43f7-a72c-6384a7ade183 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.178854 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 916/1844] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:15.181392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.186327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.187589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.187880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.188163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] PATH_INFO: `/v3/projects/23320e4dcfb04b619a41cc9693338941` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.192408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23320e4dcfb04b619a41cc9693338941)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.193099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d2928-6ae7-4ff0-977c-db0aaff1e4dc None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.196747 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.199534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933020c4-5a3b-4f4f-b326-688188d056f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.199848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933020c4-5a3b-4f4f-b326-688188d056f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.200279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933020c4-5a3b-4f4f-b326-688188d056f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.200564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933020c4-5a3b-4f4f-b326-688188d056f5 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.201311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933020c4-5a3b-4f4f-b326-688188d056f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.203458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933020c4-5a3b-4f4f-b326-688188d056f5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.235321 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 917/1845] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/users => generated 290 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:15.237309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.237647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.238320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.246729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:15.268143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:15.269568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.281944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:15.294307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23320e4dcfb04b619a41cc9693338941', 'request_id': 'req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:15.304797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23320e4dcfb04b619a41cc9693338941', 'request_id': 'req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:15.320443 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23320e4dcfb04b619a41cc9693338941', 'request_id': 'req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:15.342802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] The token cache is being invalidate because project 23320e4dcfb04b619a41cc9693338941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:15.343160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:15.344266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3e29873c-fe2d-43c6-bdd2-1ebc33830f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:15.350137 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 929/1846] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:15 2022] DELETE /identity/v3/projects/23320e4dcfb04b619a41cc9693338941 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:15.351568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d13546-c08f-46c8-8f96-2c7b5c9b9bd6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.351863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d13546-c08f-46c8-8f96-2c7b5c9b9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.352215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d13546-c08f-46c8-8f96-2c7b5c9b9bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.378193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-93d13546-c08f-46c8-8f96-2c7b5c9b9bd6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:15.379328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-93d13546-c08f-46c8-8f96-2c7b5c9b9bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.387526 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 918/1847] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:15.388488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.391982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.497995 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 930/1848] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:15.498527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.498837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.499121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.501345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee3603-cb3b-49ed-913a-11752260c214 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.509234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.510338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.510338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.511782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.512876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.514942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.523310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:15.524616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.538206 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 931/1849] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:15.539098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.540470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.558659 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 919/1850] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:15.561247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.564917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00345b-8ef2-4ae3-a142-d2cd2f6f5684 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.578508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc618-6464-4bc6-bdb6-d1cacda5105f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.585446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.585633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.586262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.586562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.586885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.586982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.587175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.587630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.588372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:15.589545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.591971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795026a6-f6fc-40f1-856a-45b68b8164f9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.600692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.602771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.614131 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 920/1851] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:15.615698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.616259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.616554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.625323 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 932/1852] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:15.628133 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.643822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:15.647971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:15.649201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad2aa-dea7-4090-af4a-2742b1d407f0 service nova] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.655856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.657005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.657672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.657962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.659132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.660999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.669164 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 921/1853] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:15.670430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.686643 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 933/1854] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:15.687542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.688538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a292f0-997d-4c80-9247-92d8ad80a265 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.695171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.696212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.696680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.697189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.698797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.701888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.711529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ceba4-af9e-47f5-bb11-ff0dadb9e797 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.720132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.721208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.721559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.721847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.722917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:15.723239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.725506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.750003 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 934/1855] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:15.750003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.756405 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 922/1856] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:15.757390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:15.765746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b15c17-fe53-4e11-8d04-31fb52b19a7b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.923589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.925086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.925594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.926086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] PATH_INFO: `/v3/projects/9e55b6ed6e7a471ca40359491507711c/users/859a414f836f4ae69133fab09602499d/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.935338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3be43-283a-44c1-a0fb-bfe7b62d22ef admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:15.946888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:15.948853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:15.949491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:15.950137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:15.952831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.957982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:15.966899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:15.980782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:15.989098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e55b6ed6e7a471ca40359491507711c, user_id=859a414f836f4ae69133fab09602499d, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:15.992267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.001534 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 923/1857] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:15 2022] POST /identity/v3/projects => generated 409 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:16.002579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.024418 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 935/1858] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:15 2022] PUT /identity/v3/projects/9e55b6ed6e7a471ca40359491507711c/users/859a414f836f4ae69133fab09602499d/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:16.027000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.042729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.099454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487edc4-c52d-4e03-b0a0-f905e18ae57e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.124479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a139f-dd2b-4206-a77f-df1e231bc6fc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.131983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.133080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.133422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.133707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] PATH_INFO: `/v3/projects/643c819ddcb24badb83acd2c063e1bdd` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.135120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=643c819ddcb24badb83acd2c063e1bdd)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.137373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.181663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.182991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.183460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.183811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.184615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.186865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.206857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643c819ddcb24badb83acd2c063e1bdd', 'request_id': 'req-7895897d-96aa-4fad-a149-04d81199b610'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.211638 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 924/1859] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:16 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:16.213219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643c819ddcb24badb83acd2c063e1bdd', 'request_id': 'req-7895897d-96aa-4fad-a149-04d81199b610'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.216175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.221460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643c819ddcb24badb83acd2c063e1bdd', 'request_id': 'req-7895897d-96aa-4fad-a149-04d81199b610'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.227222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ef2b-0ea1-4cec-8a73-a61bff315d3a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.238380 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] The token cache is being invalidate because project 643c819ddcb24badb83acd2c063e1bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:16.238936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.239638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7895897d-96aa-4fad-a149-04d81199b610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.242913 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 936/1860] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:16 2022] DELETE /identity/v3/projects/643c819ddcb24badb83acd2c063e1bdd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:16.244676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.245063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.246764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.284794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] MFA Rules not processed for user `859a414f836f4ae69133fab09602499d`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:16.286110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.322877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.325166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.325928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.327285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.328832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.332469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.383808 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 925/1861] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:16 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:16.384623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.402611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.416151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ae15-c44a-4f60-b528-ec23b9590c90 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.420670 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 937/1862] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:16.421886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.422356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.423248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.423605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.423825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.423981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.425180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.426990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.442979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d70f5b-a64e-4018-92d7-27d9966e3783 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.448626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.450005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.450348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.450629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] PATH_INFO: `/v3/users/ba0b4a4d760a496b800643a82f7c16db` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.452078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0b4a4d760a496b800643a82f7c16db)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.454047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.454873 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 926/1863] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:16.456451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.459507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.462125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:16.475449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:16.490337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8e42-8a23-4424-a9c8-15814f0bd969 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.499595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.500826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.501350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.502642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.503343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.506084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.531659 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 927/1864] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:16.531659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.533777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.537884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0b4a4d760a496b800643a82f7c16db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.552581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0b4a4d760a496b800643a82f7c16db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.556348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0b4a4d760a496b800643a82f7c16db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.562692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6771c-434a-4bbd-9103-15b60b42040d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.575168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.575989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.576613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.577097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.578620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.582594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.584597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0b4a4d760a496b800643a82f7c16db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.585382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0b4a4d760a496b800643a82f7c16db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:16.609901 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 938/1865] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:16 2022] DELETE /identity/v3/users/ba0b4a4d760a496b800643a82f7c16db => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:16.611254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.613264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.645341 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 928/1866] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:16 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:16.646716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.656187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.721429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416318de-6e46-4ce0-94ff-eaf3ad047a6f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.801928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625c5e-8d4b-4f26-bf29-9e271c7fa637 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.809649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.810645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.811200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.811584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.812833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.814767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.827109 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 929/1867] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:16.827900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.830751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:16.845369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.846115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.846235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810cb5d-4089-4d38-a2d6-9085e1701273 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.846451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.846903 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.848309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.850871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.852383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.853593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.854445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.855056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.856000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.858867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.865516 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 939/1868] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:16.866659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.883726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd033d0-157f-4505-867b-5388e5d77ea9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.895635 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 930/1869] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:16 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:16.896809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.908811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.909907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.910186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.910463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] PATH_INFO: `/v3/projects/a3ec7209aa744736a794511914b33b50/users/f9ffe0b326a946988cfa5550d044fa07/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.935477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e0f35-a4b6-4b2c-8d09-13c19a1e3646 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:16.935697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ec7209aa744736a794511914b33b50, user_id=f9ffe0b326a946988cfa5550d044fa07, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.939462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.942556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ff0b3-03d5-4253-b5a9-a2229f10b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:16.944682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ff0b3-03d5-4253-b5a9-a2229f10b5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.945386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ff0b3-03d5-4253-b5a9-a2229f10b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.946149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ff0b3-03d5-4253-b5a9-a2229f10b5a5 admin admin] PATH_INFO: `/v3/projects/14fc7228152245519ca07de288b9f0a9/users/ef64510bc3234135aa920684c7eb0fc6/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:16.952367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:16.967036 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 940/1870] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:16 2022] PUT /identity/v3/projects/a3ec7209aa744736a794511914b33b50/users/f9ffe0b326a946988cfa5550d044fa07/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:16.967254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ff0b3-03d5-4253-b5a9-a2229f10b5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fc7228152245519ca07de288b9f0a9, user_id=ef64510bc3234135aa920684c7eb0fc6, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:16.968586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:16.970354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ff0b3-03d5-4253-b5a9-a2229f10b5a5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:16.993973 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 931/1871] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:16 2022] PUT /identity/v3/projects/14fc7228152245519ca07de288b9f0a9/users/ef64510bc3234135aa920684c7eb0fc6/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:16.996120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd84e3e-b201-4309-9314-9c2cc03e1e91 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:16.996616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd84e3e-b201-4309-9314-9c2cc03e1e91 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:16.996726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd84e3e-b201-4309-9314-9c2cc03e1e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.025706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3fd84e3e-b201-4309-9314-9c2cc03e1e91 None None] MFA Rules not processed for user `f9ffe0b326a946988cfa5550d044fa07`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:17.029307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3fd84e3e-b201-4309-9314-9c2cc03e1e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.116114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c95d-1d66-46f8-a2ec-f76228862f24 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.136412 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 932/1872] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:17.137776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.138080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.138428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.180441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:17.186724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] MFA Rules not processed for user `ef64510bc3234135aa920684c7eb0fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:17.189457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.228025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.231519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.231982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.233397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.235265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.239165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.265067 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 941/1873] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:17.266279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.270688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.299169 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 933/1874] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:17.303128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.306110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40e5d-9eeb-4b56-87b9-9b5292b1e873 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.311927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.313327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.313978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.314405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] PATH_INFO: `/v3/projects/64a8ccdbcb454969ac88b2ea06d539ac` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.316652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a8ccdbcb454969ac88b2ea06d539ac)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.319242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.324508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20e093-f987-49a2-a859-a86284d69a0c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.345747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.347459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.347756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.348335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.349121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.351321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.396405 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 934/1875] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:17.398378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.417925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a8ccdbcb454969ac88b2ea06d539ac', 'request_id': 'req-d50a5e5b-ee12-4f2d-bba6-fab24737500e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:17.426239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a8ccdbcb454969ac88b2ea06d539ac', 'request_id': 'req-d50a5e5b-ee12-4f2d-bba6-fab24737500e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:17.451447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a8ccdbcb454969ac88b2ea06d539ac', 'request_id': 'req-d50a5e5b-ee12-4f2d-bba6-fab24737500e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:17.482691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] The token cache is being invalidate because project 64a8ccdbcb454969ac88b2ea06d539ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:17.483276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:17.492445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:17.494226 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 942/1876] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:17 2022] DELETE /identity/v3/projects/64a8ccdbcb454969ac88b2ea06d539ac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:17.499459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.501574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.545805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad2ce-75ba-432e-9b6e-6c630f65f85f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.563136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:17.612939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a5e5b-ee12-4f2d-bba6-fab24737500e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.618804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.621209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.621642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.622027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.622975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.625242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.631287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd661b-7c82-43d4-b709-3e336c213d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.632803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd661b-7c82-43d4-b709-3e336c213d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.633278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd661b-7c82-43d4-b709-3e336c213d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.633707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd661b-7c82-43d4-b709-3e336c213d26 admin admin] PATH_INFO: `/v3/projects/c3a64453828649dd801ac5eb9836ee32/users/5cfe7a57fb3848f69e844eef00d9167c/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.658566 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 943/1877] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:17.659369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.661218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.662246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd661b-7c82-43d4-b709-3e336c213d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a64453828649dd801ac5eb9836ee32, user_id=5cfe7a57fb3848f69e844eef00d9167c, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.665038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd661b-7c82-43d4-b709-3e336c213d26 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.689814 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 935/1878] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:17 2022] PUT /identity/v3/projects/c3a64453828649dd801ac5eb9836ee32/users/5cfe7a57fb3848f69e844eef00d9167c/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:17.691212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107631-1019-4d92-a590-36a674ae93fc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.691511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107631-1019-4d92-a590-36a674ae93fc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.691912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107631-1019-4d92-a590-36a674ae93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.721944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-94107631-1019-4d92-a590-36a674ae93fc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:17.723385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-94107631-1019-4d92-a590-36a674ae93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.730435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:17.796947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1114b-af8c-4693-b717-b18f3830c058 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.819962 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 936/1879] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:17.819962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107631-1019-4d92-a590-36a674ae93fc None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.836117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107631-1019-4d92-a590-36a674ae93fc None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.843103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.844104 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.844397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.844810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.845619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.862324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.887561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6f1a1-6405-4118-9912-a785dbccb133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.888471 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f1a1-6405-4118-9912-a785dbccb133 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.888858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f1a1-6405-4118-9912-a785dbccb133 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.889273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f1a1-6405-4118-9912-a785dbccb133 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.890076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6f1a1-6405-4118-9912-a785dbccb133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.892155 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6f1a1-6405-4118-9912-a785dbccb133 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.916017 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 937/1880] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:17.918280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.920901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.923988 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 944/1881] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/users => generated 309 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:17.926081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.926371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.926835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.936804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a59c4-bd84-4b3a-b331-5230935b4114 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.945730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.947737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.948262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.948721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.949669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.952026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.956322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:17.957910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:17.967411 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 938/1882] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:17.968745 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 945/1883] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:17.969418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.970606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:17.984396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886069-3f17-4a20-85da-35ef810a20f9 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.984630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26486-91bb-45a5-8919-6063207b7535 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:17.991180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.991955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.992313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.992691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.993639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:17.995574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:17.995773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:17.996358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:17.996647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:17.996993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:17.998030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.000068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.013414 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 946/1884] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:18.014936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.020041 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 939/1885] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:18.020041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.030664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efbf22-2b73-4a7e-8e8b-d92bd53f67a2 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.038365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.039131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.039592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.040461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] PATH_INFO: `/v3/projects/c3a64453828649dd801ac5eb9836ee32/users/5cfe7a57fb3848f69e844eef00d9167c/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.042735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a64453828649dd801ac5eb9836ee32, user_id=5cfe7a57fb3848f69e844eef00d9167c, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.045928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.046251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c569a-533e-4141-89ed-a6edfd63503e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.055631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.056609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.056609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.056910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.057846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:18.058429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.060463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.061307 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 947/1886] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:18 2022] PUT /identity/v3/projects/c3a64453828649dd801ac5eb9836ee32/users/5cfe7a57fb3848f69e844eef00d9167c/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:18.062922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.079629 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 940/1887] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:18.080712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.099445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:18.107339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a921f-0772-4e2c-b022-ca5553248ce8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.159830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bbd53-8a40-4ccc-95d7-e876d28df3ee admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.165371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900406ee-54e2-47a4-95ab-f33d965aba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.166268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900406ee-54e2-47a4-95ab-f33d965aba85 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.166555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900406ee-54e2-47a4-95ab-f33d965aba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.167403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900406ee-54e2-47a4-95ab-f33d965aba85 admin admin] PATH_INFO: `/v3/projects/c682698f1bda431cb96547d927a5080d/users/d556392888cc48fda2425239571712e2/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.185795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.186744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.187099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.187384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] PATH_INFO: `/v3/projects/f9f71660cdbb4915a13f5fd2d83b8a3c/users/25d32f7fb5894ab3a74985841e2dbbb2/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.192535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900406ee-54e2-47a4-95ab-f33d965aba85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c682698f1bda431cb96547d927a5080d, user_id=d556392888cc48fda2425239571712e2, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.195314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900406ee-54e2-47a4-95ab-f33d965aba85 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.203644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f71660cdbb4915a13f5fd2d83b8a3c, user_id=25d32f7fb5894ab3a74985841e2dbbb2, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.206637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.217157 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 948/1888] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:18 2022] PUT /identity/v3/projects/c682698f1bda431cb96547d927a5080d/users/d556392888cc48fda2425239571712e2/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:18.218378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.218669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.219214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.227654 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 941/1889] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:18 2022] PUT /identity/v3/projects/f9f71660cdbb4915a13f5fd2d83b8a3c/users/25d32f7fb5894ab3a74985841e2dbbb2/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:18.228409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.250178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] MFA Rules not processed for user `5cfe7a57fb3848f69e844eef00d9167c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:18.251552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.290947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:18.314700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d40a-f916-471b-8ebe-2edfa183acee admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.320125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.320919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.321312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.321736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.322367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.325820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.344379 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 949/1890] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:18.344379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.355755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d86f9b-f7f2-4ab1-adf8-a22f3313d27e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.360749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.361571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.361857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.362127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.362844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.364473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.367864 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 942/1891] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:18 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:18.367864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.378697 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 950/1892] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:18.379557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.381280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.394614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15df66-5089-4214-abf6-5874b21c5a21 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.432157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a621-617f-4852-ad6d-0d9ef0ce7a24 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.437898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.438569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.438857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.439138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.439867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.441515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.450324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.451159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.451444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.451722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] PATH_INFO: `/v3/users/3f33a56c887b47e590d31b543ced5aa4` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.452655 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 943/1893] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:18.452925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f33a56c887b47e590d31b543ced5aa4)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.453576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.454908 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.455244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.472930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:18.506698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f33a56c887b47e590d31b543ced5aa4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:18.514061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f33a56c887b47e590d31b543ced5aa4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:18.514745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f33a56c887b47e590d31b543ced5aa4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:18.516322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9053ea-cc97-47ba-a7ea-6c1b5906580a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.520229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.520997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.521366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.521646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.522399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f33a56c887b47e590d31b543ced5aa4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:18.523066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f33a56c887b47e590d31b543ced5aa4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:18.540901 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 951/1894] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:18 2022] DELETE /identity/v3/users/3f33a56c887b47e590d31b543ced5aa4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:18.541789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.543688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.587741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.590103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.600643 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 944/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:18.601216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.613997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b75e-7d17-4556-b636-69f5d56f24e7 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.614589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e62595-c46d-4816-aaa3-a417e3cbafb4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.619157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.619611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79f0c-0b51-4881-a4de-86935c200622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.620503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.620871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79f0c-0b51-4881-a4de-86935c200622 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.620965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.621046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79f0c-0b51-4881-a4de-86935c200622 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.621117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] PATH_INFO: `/v3/projects/c682698f1bda431cb96547d927a5080d/users/d556392888cc48fda2425239571712e2/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.621332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79f0c-0b51-4881-a4de-86935c200622 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.621973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79f0c-0b51-4881-a4de-86935c200622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.623075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c682698f1bda431cb96547d927a5080d, user_id=d556392888cc48fda2425239571712e2, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.623906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79f0c-0b51-4881-a4de-86935c200622 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.625764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.632297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:18.637898 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 945/1896] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:18 2022] PUT /identity/v3/projects/c682698f1bda431cb96547d927a5080d/users/d556392888cc48fda2425239571712e2/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:18.638734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.648467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.657664 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 952/1897] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:18 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:18.659262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee611e-3bd6-487c-986f-1e89b10dd9cc None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.659461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee611e-3bd6-487c-986f-1e89b10dd9cc None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.659745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee611e-3bd6-487c-986f-1e89b10dd9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.681646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-16ee611e-3bd6-487c-986f-1e89b10dd9cc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:18.683070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-16ee611e-3bd6-487c-986f-1e89b10dd9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.753464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db00e9-c1f7-4b1d-8f4f-7a1063c627e9 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.759581 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.761230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.761520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.761799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] PATH_INFO: `/v3/projects/f9f71660cdbb4915a13f5fd2d83b8a3c/users/25d32f7fb5894ab3a74985841e2dbbb2/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.764908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f71660cdbb4915a13f5fd2d83b8a3c, user_id=25d32f7fb5894ab3a74985841e2dbbb2, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.768613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.780357 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 953/1898] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:18.782057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384daa5-d037-4424-8e57-8f70c8d893cf None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.782730 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384daa5-d037-4424-8e57-8f70c8d893cf None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.783403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384daa5-d037-4424-8e57-8f70c8d893cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.797539 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 946/1899] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:18 2022] PUT /identity/v3/projects/f9f71660cdbb4915a13f5fd2d83b8a3c/users/25d32f7fb5894ab3a74985841e2dbbb2/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:18.798949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.826874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d384daa5-d037-4424-8e57-8f70c8d893cf None None] MFA Rules not processed for user `d556392888cc48fda2425239571712e2`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:18.829831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d384daa5-d037-4424-8e57-8f70c8d893cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.849970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:18.913679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1123-91ed-4211-aa51-5cbd9feaa663 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:18.919715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:18.920833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.921126 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.921464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.922202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:18.923811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:18.935528 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 947/1900] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:18.936450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:18.940042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:18.952853 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 954/1901] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:18.954800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:18.955085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:18.955370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:18.984270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] MFA Rules not processed for user `25d32f7fb5894ab3a74985841e2dbbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:18.985530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.025595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cf409-9910-48e8-a33c-3b3672d8aa33 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.030254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.030919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.031201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.031473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.044878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.046364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.063859 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 948/1902] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:19.064798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.069884 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 955/1903] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:19.075414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.077069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.089852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed921bc8-b8af-45d9-a075-b07f9da458b5 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.095555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.096416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.096857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.097177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.098762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.101623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.122002 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 949/1904] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:19.124708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.129614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.165165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:19.220101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceefb16-1e6c-4a23-997b-6148c1c8baa8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.223645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be9b6d-5b69-44d0-8478-a4e6413b6c85 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.226388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.228109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.228513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.228888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.232532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfe7a57fb3848f69e844eef00d9167c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3a64453828649dd801ac5eb9836ee32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.233401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.233741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.234611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.235408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:19.235746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.238119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.245821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.247528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.259213 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 956/1905] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:19.259664 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 950/1906] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:19.260465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.261195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.262851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.278223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14e5b-3b04-4366-9112-f15efbb82903 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.281797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b95a8-88f2-4626-bac9-a834f48aca99 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.283755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.284533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.284900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.285318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.289181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089fcd-848d-4142-bb60-96af65ce42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.290491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089fcd-848d-4142-bb60-96af65ce42b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.290613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089fcd-848d-4142-bb60-96af65ce42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.290900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089fcd-848d-4142-bb60-96af65ce42b4 admin admin] PATH_INFO: `/v3/projects/e5c9312c36524934870ccbb4a59b78d7/users/49767009e14a4cc68b343474a071306b/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.304939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.306504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.316388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089fcd-848d-4142-bb60-96af65ce42b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c9312c36524934870ccbb4a59b78d7, user_id=49767009e14a4cc68b343474a071306b, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.319640 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 957/1907] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:19.319847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089fcd-848d-4142-bb60-96af65ce42b4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.331799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.357245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc04a3-9545-4e9d-bf0e-98619f964f5d service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.357448 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 951/1908] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:19 2022] PUT /identity/v3/projects/e5c9312c36524934870ccbb4a59b78d7/users/49767009e14a4cc68b343474a071306b/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:19.368330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.368701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.369325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.423299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] MFA Rules not processed for user `49767009e14a4cc68b343474a071306b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:19.424863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.428026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:19.532142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfe7a57fb3848f69e844eef00d9167c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3a64453828649dd801ac5eb9836ee32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.532828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.533112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.533416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.534121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.550582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.591338 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 952/1909] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:19.595894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.607781 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 958/1910] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:19 2022] POST /identity/v3/projects => generated 353 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:19.609010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.701753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1803a-ce2e-4c2c-bc1e-ce4d84d96610 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.710785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.712083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.712083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.712315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.712838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.715530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.733222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367d09-4907-47b4-9265-90bf166dd21e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.763524 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 959/1911] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:19 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:19.763524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.791744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:19.814150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.815119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.815408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.815688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.817649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.875741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4008660-0340-42c9-a8bf-19bb37be2361 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.882326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfe7a57fb3848f69e844eef00d9167c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3a64453828649dd801ac5eb9836ee32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.883517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.883837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.884123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.884893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:19.886118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.888461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.904428 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 960/1912] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:19.905405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.906941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:19.908547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:19.921561 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 953/1913] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:19.922691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:19.924046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:19.947428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:19.962686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792fc8a-7cfb-4e7c-b8ae-0b2f0ee0bdd0 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.976658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664c7aa-1722-460f-8313-a861da7eb584 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:19.981289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:19.982028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:19.982385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:19.982758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:19.984817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:20.032737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.033694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.033982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.034259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] PATH_INFO: `/v3/projects/84ff2dcb024e47cd94bdfcf0f6078577` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.036140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ff2dcb024e47cd94bdfcf0f6078577)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.038821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.059948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.062463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.077060 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 961/1914] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:20.080303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.094989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37adc-0210-4d83-bb80-90e36325a57e service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.102779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.104036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.104880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.105316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.106096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.108403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.149839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ff2dcb024e47cd94bdfcf0f6078577', 'request_id': 'req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.158554 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 962/1915] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:20 2022] POST /identity/v3/users => generated 301 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:20.159733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.163031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ff2dcb024e47cd94bdfcf0f6078577', 'request_id': 'req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.173829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f061f66-20dc-4424-ae28-33c61abe28f4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.176737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ff2dcb024e47cd94bdfcf0f6078577', 'request_id': 'req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.198376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] The token cache is being invalidate because project 84ff2dcb024e47cd94bdfcf0f6078577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:20.199367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.200856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.202891 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 954/1916] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:19 2022] DELETE /identity/v3/projects/84ff2dcb024e47cd94bdfcf0f6078577 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:20.206695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.208334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:20.248860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:20.278229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.278942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.279225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.279501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.280238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.282103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.294588 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 963/1917] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:20.299431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.302201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:20.328710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd7132-248d-4559-a18e-4a4942757fe1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.340668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.341730 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.342221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.342987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] PATH_INFO: `/v3/projects/e00936b011c54653b78087b1b52e4680/users/857a87dd165a4db8a88a266febfcdbea/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.355881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa5ba-f83a-4536-9ba8-703a48135a4d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.361714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.362808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00936b011c54653b78087b1b52e4680, user_id=857a87dd165a4db8a88a266febfcdbea, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.363049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.363538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.363919 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] PATH_INFO: `/v3/users/3a766cb8182c4461ae09e870da533101` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.366181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a766cb8182c4461ae09e870da533101)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.367482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.369400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.388605 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 964/1918] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:20 2022] PUT /identity/v3/projects/e00936b011c54653b78087b1b52e4680/users/857a87dd165a4db8a88a266febfcdbea/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:20.389620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.391266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:20.455736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a766cb8182c4461ae09e870da533101'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.462648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:20.484997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a766cb8182c4461ae09e870da533101'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.486720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a766cb8182c4461ae09e870da533101'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.502898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68def24-10ef-48d3-9e73-58dada767028 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.504190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a766cb8182c4461ae09e870da533101'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.510162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfe7a57fb3848f69e844eef00d9167c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3a64453828649dd801ac5eb9836ee32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.512251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.512555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.512986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] PATH_INFO: `/v3/projects/d65cd2186ebb4f14be1def54f4b51baf` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.514508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d65cd2186ebb4f14be1def54f4b51baf)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.515406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a766cb8182c4461ae09e870da533101'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.516601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.524994 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 955/1919] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:20 2022] DELETE /identity/v3/users/3a766cb8182c4461ae09e870da533101 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:20.528884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.537455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:20.617764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65cd2186ebb4f14be1def54f4b51baf', 'request_id': 'req-aa54e891-ec56-4423-9b3f-85011880d3a1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.635881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65cd2186ebb4f14be1def54f4b51baf', 'request_id': 'req-aa54e891-ec56-4423-9b3f-85011880d3a1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.646472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65cd2186ebb4f14be1def54f4b51baf', 'request_id': 'req-aa54e891-ec56-4423-9b3f-85011880d3a1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.663443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ba97-f7bc-4f6c-bf81-a9e5ce0f90d7 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.669829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] The token cache is being invalidate because project d65cd2186ebb4f14be1def54f4b51baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:20.670627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.671538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:20.675263 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 965/1920] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:20 2022] DELETE /identity/v3/projects/d65cd2186ebb4f14be1def54f4b51baf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:20.784320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:20.833017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95e4d0-15fe-4f38-987d-42d9a746255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.835752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95e4d0-15fe-4f38-987d-42d9a746255b admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.835925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95e4d0-15fe-4f38-987d-42d9a746255b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.836209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95e4d0-15fe-4f38-987d-42d9a746255b admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.837236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95e4d0-15fe-4f38-987d-42d9a746255b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.839250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95e4d0-15fe-4f38-987d-42d9a746255b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.892446 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 956/1921] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:20.899278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:20.902945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:20.925356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54e891-ec56-4423-9b3f-85011880d3a1 tempest-VolumeQuotaClassesTest-1927175183 tempest-VolumeQuotaClassesTest-1927175183-project-admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:20.932766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:20.934198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.934576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.934868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] PATH_INFO: `/v3/projects/e00936b011c54653b78087b1b52e4680/users/857a87dd165a4db8a88a266febfcdbea/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:20.938927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00936b011c54653b78087b1b52e4680, user_id=857a87dd165a4db8a88a266febfcdbea, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:20.942561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:20.961072 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 966/1922] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:20 2022] PUT /identity/v3/projects/e00936b011c54653b78087b1b52e4680/users/857a87dd165a4db8a88a266febfcdbea/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:20.973476 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:20.973976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:20.974388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.026848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] MFA Rules not processed for user `857a87dd165a4db8a88a266febfcdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:21.027421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.057362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.060598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.176048 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 957/1923] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:21.177109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.178726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.232243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eaf50-b41f-49cd-a1b3-13a19e5c7fae admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.251046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.262120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.262418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.262702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] PATH_INFO: `/v3/users/859a414f836f4ae69133fab09602499d` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.268252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859a414f836f4ae69133fab09602499d)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.270274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.320884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f470d8-46d0-4f3a-901a-b342cef5c4c3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.337846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.344918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.344918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.344918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] PATH_INFO: `/v3/projects/6fc9976fb9c14b26a623ef3fd0e673d0` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.344918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc9976fb9c14b26a623ef3fd0e673d0)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.344918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.397852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859a414f836f4ae69133fab09602499d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.410413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859a414f836f4ae69133fab09602499d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.411603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859a414f836f4ae69133fab09602499d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.416175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:21.426849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859a414f836f4ae69133fab09602499d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.427716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859a414f836f4ae69133fab09602499d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.431352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc9976fb9c14b26a623ef3fd0e673d0', 'request_id': 'req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.438685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc9976fb9c14b26a623ef3fd0e673d0', 'request_id': 'req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.448749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc9976fb9c14b26a623ef3fd0e673d0', 'request_id': 'req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.457286 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 967/1924] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:21 2022] DELETE /identity/v3/users/859a414f836f4ae69133fab09602499d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:21.457973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:21.458396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.460866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.466108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] The token cache is being invalidate because project 6fc9976fb9c14b26a623ef3fd0e673d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:21.466665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.467830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1fadc83a-eb9b-44eb-a2a7-4cad08c13c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:21.469792 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 958/1925] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:21 2022] DELETE /identity/v3/projects/6fc9976fb9c14b26a623ef3fd0e673d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:21.471045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63463cc3-67cc-4aff-9db1-75137a83bff8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.471576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63463cc3-67cc-4aff-9db1-75137a83bff8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.471954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63463cc3-67cc-4aff-9db1-75137a83bff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.490361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-63463cc3-67cc-4aff-9db1-75137a83bff8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:21.491649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-63463cc3-67cc-4aff-9db1-75137a83bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.522879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdceb3-bbd2-4d2e-94e4-d3ddf75c0b03 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.527235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.527911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.528196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.528488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.530370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.556258 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 959/1926] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:21.556258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.556258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.556258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.575576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:21.576804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.589265 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 960/1927] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:21.590335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.591913 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.610946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.612414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf318c8-160f-42a9-957c-247891cd39a8 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.622824 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 968/1928] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:21.623960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.624233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.624510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.646958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:21.648287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.660893 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 969/1929] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:21.662305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.674544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab21c3-b33c-4104-9011-75dc8913ae3b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.681174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.681822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.682115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.682414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.684764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bfa1b-d0ca-44e3-a7f2-0cb8c7072458 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.694143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.695214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.695582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.696051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.697096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:21.697663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.700524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.700685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.702510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.720052 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 961/1930] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:21.720992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.722529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.736895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f207-3572-4acc-a394-4bfd19e6941e service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.742440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.743146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.743437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.743721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.745945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:21.754075 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 970/1931] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:48:21.759873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.783628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ee3d-3436-4e85-b5b6-3896400c5151 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.791405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.792877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.793166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.793443 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.794149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.796228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.836006 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 971/1932] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:21 2022] POST /identity/v3/projects => generated 357 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:21.840736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.852305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.853925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.865411 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 962/1933] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:21.904282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:21.928226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700d995-07fb-4d00-b334-7c30515b9c1d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:21.934679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:21.935440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:21.936068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:21.936068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:21.936840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:21.939014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:21.977273 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 972/1934] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:21 2022] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:21.982024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:21.995431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237a63-bd26-478e-add8-ffa664bdfa26 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.001004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.003392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.003902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.004381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.005127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.006785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.018861 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 963/1935] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:22.023604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.035719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c828e-b8f7-460f-8a7e-3354a019ef3b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.042563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8c805-d6dc-4cb1-acab-44c296894604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.043185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8c805-d6dc-4cb1-acab-44c296894604 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.043474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8c805-d6dc-4cb1-acab-44c296894604 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.043753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8c805-d6dc-4cb1-acab-44c296894604 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.044489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8c805-d6dc-4cb1-acab-44c296894604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.046209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8c805-d6dc-4cb1-acab-44c296894604 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.058202 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 973/1936] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:22.062612 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.076975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9af7-4495-42d4-a15a-a9a82a74f03b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.087513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.088631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.089058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.089632 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] PATH_INFO: `/v3/projects/c8ca44e9eab5455da60e81112234026f/users/c8653fd1cf1640188ca284102eae0b56/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.110288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ca44e9eab5455da60e81112234026f, user_id=c8653fd1cf1640188ca284102eae0b56, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.113127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.125499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:22.133215 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 964/1937] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:22 2022] PUT /identity/v3/projects/c8ca44e9eab5455da60e81112234026f/users/c8653fd1cf1640188ca284102eae0b56/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:22.144300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.144578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.144914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.178906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] MFA Rules not processed for user `c8653fd1cf1640188ca284102eae0b56`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:22.180726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:22.196803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.199338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:22.300102 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 974/1938] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:22.305709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.345896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febcaf1-4696-4634-8777-fa0b994e9c2a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.352199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.353518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.355019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.355706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] PATH_INFO: `/v3/projects/9e55b6ed6e7a471ca40359491507711c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.357334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e55b6ed6e7a471ca40359491507711c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.361380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.441399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdeaae-aa49-405d-90ad-a11e775c618b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.454165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e55b6ed6e7a471ca40359491507711c', 'request_id': 'req-60e36189-7a24-44bf-8571-4a26a77d4446'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.464035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e55b6ed6e7a471ca40359491507711c', 'request_id': 'req-60e36189-7a24-44bf-8571-4a26a77d4446'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.481435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e55b6ed6e7a471ca40359491507711c', 'request_id': 'req-60e36189-7a24-44bf-8571-4a26a77d4446'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.508695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] The token cache is being invalidate because project 9e55b6ed6e7a471ca40359491507711c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:22.509093 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.509891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.513750 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 965/1939] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:22 2022] DELETE /identity/v3/projects/9e55b6ed6e7a471ca40359491507711c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:22.518526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.521657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:22.537969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:22.548185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.549215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.549705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.550248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.551165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.553505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.605581 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 975/1940] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:22 2022] POST /identity/v3/projects => generated 353 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:22.610150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.612280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:22.653496 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36189-7a24-44bf-8571-4a26a77d4446 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.695079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeca3c-5fef-41a3-aa04-3eb29b61eb35 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.701306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:22.702279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.703168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.703558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.703945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.705616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.708251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.730618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.732270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.735624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.735624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] PATH_INFO: `/v3/users/5cfe7a57fb3848f69e844eef00d9167c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.735624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfe7a57fb3848f69e844eef00d9167c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.737769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.740870 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 976/1941] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:22 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:22.745924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.756690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c7c80-1dac-444b-b9ad-a09e49e66b7a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.761839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.762515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.762801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.763078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.763812 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.765465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.783433 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 977/1942] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:22.787957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.800180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12812764-d223-47d4-be9d-e1c2ed93e6d3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:22.804899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:22.806132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:22.806417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:22.806688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] PATH_INFO: `/v3/projects/1ff42009f09a4336b459ca2af2d26656/users/d2014133e2c146f197566789096dfc98/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:22.823926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfe7a57fb3848f69e844eef00d9167c'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.825172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff42009f09a4336b459ca2af2d26656, user_id=d2014133e2c146f197566789096dfc98, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:22.828043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:22.832199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfe7a57fb3848f69e844eef00d9167c'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.832935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfe7a57fb3848f69e844eef00d9167c'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.847483 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 978/1943] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:22 2022] PUT /identity/v3/projects/1ff42009f09a4336b459ca2af2d26656/users/d2014133e2c146f197566789096dfc98/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:22.847673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfe7a57fb3848f69e844eef00d9167c'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.851509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:22.856211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfe7a57fb3848f69e844eef00d9167c'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:22.868411 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 966/1944] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:22 2022] DELETE /identity/v3/users/5cfe7a57fb3848f69e844eef00d9167c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:23.015419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d8317-fbb5-4ffe-98ca-743a0c787c2b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:23.080549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:23.108395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a1b0-0e06-4dfa-962a-fa747358a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:23.109233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a1b0-0e06-4dfa-962a-fa747358a9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.109537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a1b0-0e06-4dfa-962a-fa747358a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.109878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a1b0-0e06-4dfa-962a-fa747358a9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.110678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610a1b0-0e06-4dfa-962a-fa747358a9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:23.113757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610a1b0-0e06-4dfa-962a-fa747358a9a0 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:23.132397 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 979/1945] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:23.132773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:23.134674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.155143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83798a-7e3d-47c6-8875-f0f05547e5ca admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:23.171222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:23.172263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.172440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.172706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] PATH_INFO: `/v3/projects/1ff42009f09a4336b459ca2af2d26656/users/d2014133e2c146f197566789096dfc98/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.183017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff42009f09a4336b459ca2af2d26656, user_id=d2014133e2c146f197566789096dfc98, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:23.188512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:23.233578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.234191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.234692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.236697 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 967/1946] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:23 2022] PUT /identity/v3/projects/1ff42009f09a4336b459ca2af2d26656/users/d2014133e2c146f197566789096dfc98/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:23.241652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:23.252429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.304135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] MFA Rules not processed for user `d2014133e2c146f197566789096dfc98`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:23.305581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.414332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343876c-a31d-4aac-ae3f-7347847dda91 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:23.426483 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:23.427385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.427668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.427945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] PATH_INFO: `/v3/users/ef64510bc3234135aa920684c7eb0fc6` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.431674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef64510bc3234135aa920684c7eb0fc6)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:23.434592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:23.469024 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 980/1947] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:23.469024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:23.469024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.492022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22745dc1-b4de-499f-ab83-4dd3c3902d5a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:23.498609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:23.499612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.500141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.500488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] PATH_INFO: `/v3/projects/c3a64453828649dd801ac5eb9836ee32` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.502173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a64453828649dd801ac5eb9836ee32)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:23.504722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:23.519067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:23.521454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef64510bc3234135aa920684c7eb0fc6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.534090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef64510bc3234135aa920684c7eb0fc6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.535193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef64510bc3234135aa920684c7eb0fc6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.550933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef64510bc3234135aa920684c7eb0fc6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.572073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef64510bc3234135aa920684c7eb0fc6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.587961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a64453828649dd801ac5eb9836ee32', 'request_id': 'req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.595980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a64453828649dd801ac5eb9836ee32', 'request_id': 'req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.600553 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 968/1948] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:23 2022] DELETE /identity/v3/users/ef64510bc3234135aa920684c7eb0fc6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:23.601785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:23.603512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a64453828649dd801ac5eb9836ee32', 'request_id': 'req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.604384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.626744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] The token cache is being invalidate because project c3a64453828649dd801ac5eb9836ee32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:23.627297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.628452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b6dbaa53-2b53-436c-b42e-b0ca29f21d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:23.630927 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 981/1949] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:23 2022] DELETE /identity/v3/projects/c3a64453828649dd801ac5eb9836ee32 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:23.632241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a570ce-00b0-4caa-83fe-b264b028fb2e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.632530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a570ce-00b0-4caa-83fe-b264b028fb2e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.632824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a570ce-00b0-4caa-83fe-b264b028fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.664289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-83a570ce-00b0-4caa-83fe-b264b028fb2e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:23.665781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-83a570ce-00b0-4caa-83fe-b264b028fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.699117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47594a94-ae82-4d4a-9df6-9336e61d9300 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:23.703013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:23.704323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.706758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.706991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.709424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.767250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:23.811599 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 982/1950] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:23.814451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f8a5e-2fbe-42ce-acfe-25a796ccc780 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.815053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f8a5e-2fbe-42ce-acfe-25a796ccc780 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.817224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f8a5e-2fbe-42ce-acfe-25a796ccc780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.825589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:23.829238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:23.851205 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 969/1951] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:23 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:23.852110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:23.853939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.859683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ee8f8a5e-2fbe-42ce-acfe-25a796ccc780 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:23.861866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ee8f8a5e-2fbe-42ce-acfe-25a796ccc780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.884528 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 983/1952] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:23.892520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.893118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.893462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.931915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:23.934089 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:23.951609 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 984/1953] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:23.954490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:23.968368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a0df6-4219-4930-ae0e-928d7471730c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:23.976248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:23.977278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:23.977631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:23.978009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:23.978895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:23.979829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:23.982072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.001695 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 985/1954] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:24.003231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.015617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a119-24e7-43c5-8184-2403838393bc service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.022818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.025893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e99db-8f85-44f3-a0ea-eff78c9e3857 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.027189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.027683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.028041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.041297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.043185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.043799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.044030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.045178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.047814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.048786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.052087 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.066617 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 970/1955] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:24.122002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.130547 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 986/1956] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:24 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:24.148320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56e94-9721-4b49-b3ee-47a1404dfe9c service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.167950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.172303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:24.188164 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:24.313191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.314365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.314365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.314993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75aa8-5f2f-4c1d-b7e1-92edac702c34 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.315735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.317411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.319328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.320033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.320417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.320785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.321172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.323077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:24.376591 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 971/1957] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:24 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:24.380729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.404053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac836a-cb66-41aa-a7c1-6b069ef3b21b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.426424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.427656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.428158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.428627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.429575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.431367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.442533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.444085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.448892 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 972/1958] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:24.452999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.467415 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 987/1959] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:24.468569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc88b-42d6-418e-9e19-c31e441103bf admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.477003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655c13f-4ead-4ac7-ae68-5d7a6d5d601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.477884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655c13f-4ead-4ac7-ae68-5d7a6d5d601e admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.478260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655c13f-4ead-4ac7-ae68-5d7a6d5d601e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.478632 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655c13f-4ead-4ac7-ae68-5d7a6d5d601e admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.481000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655c13f-4ead-4ac7-ae68-5d7a6d5d601e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.483742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655c13f-4ead-4ac7-ae68-5d7a6d5d601e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.506053 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 973/1960] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:24.511231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.523414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c8d6-1cdc-4620-9022-17fd691d3313 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.530385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.531297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.531582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.531956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] PATH_INFO: `/v3/projects/ac0f1e0a0dd54b58a58ab800f8da1167/users/1616d0b2af1a41abb4bce4592216fd4a/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.566257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0f1e0a0dd54b58a58ab800f8da1167, user_id=1616d0b2af1a41abb4bce4592216fd4a, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.569231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.614423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.614788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.614990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.615178 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 988/1961] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:24 2022] PUT /identity/v3/projects/ac0f1e0a0dd54b58a58ab800f8da1167/users/1616d0b2af1a41abb4bce4592216fd4a/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:24.678503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] MFA Rules not processed for user `1616d0b2af1a41abb4bce4592216fd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:24.681352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:24.690561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.692924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:24.754413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:24.857942 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 974/1962] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:24.868253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1238-f52d-4993-9f7b-2594962947c9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:24.875426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:24.875904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:24.877169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:24.877169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:24.877607 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] PATH_INFO: `/v3/projects/14fc7228152245519ca07de288b9f0a9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:24.878365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:24.879644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fc7228152245519ca07de288b9f0a9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:24.882610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:24.986935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fc7228152245519ca07de288b9f0a9', 'request_id': 'req-6a04874f-6414-4e64-af48-0cf52a3718a9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.001375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fc7228152245519ca07de288b9f0a9', 'request_id': 'req-6a04874f-6414-4e64-af48-0cf52a3718a9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.015259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fc7228152245519ca07de288b9f0a9', 'request_id': 'req-6a04874f-6414-4e64-af48-0cf52a3718a9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.033602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49843-1efc-49ed-b241-0bd564edcaab None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:25.043187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] The token cache is being invalidate because project 14fc7228152245519ca07de288b9f0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:25.043831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.048048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.050546 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 989/1963] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:24 2022] DELETE /identity/v3/projects/14fc7228152245519ca07de288b9f0a9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:25.056347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:25.059061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:25.085082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:25.136515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:25.138033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:25.138745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:25.139226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:25.142254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:25.178874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04874f-6414-4e64-af48-0cf52a3718a9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:25.187943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:25.189501 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:25.189895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:25.190331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] PATH_INFO: `/v3/users/25d32f7fb5894ab3a74985841e2dbbb2` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:25.191827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d32f7fb5894ab3a74985841e2dbbb2)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:25.196257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:25.243190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:25.246177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:25.259945 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 975/1964] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:25.270886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d32f7fb5894ab3a74985841e2dbbb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.279245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d32f7fb5894ab3a74985841e2dbbb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.280115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d32f7fb5894ab3a74985841e2dbbb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.307984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d32f7fb5894ab3a74985841e2dbbb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.309403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8ff64817-ca9c-4813-9e7d-35ef5b8d3b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d32f7fb5894ab3a74985841e2dbbb2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.311212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:25.363386 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 990/1965] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:25 2022] DELETE /identity/v3/users/25d32f7fb5894ab3a74985841e2dbbb2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:25.439874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:25.441362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:25.456288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113481-e654-4c91-bafe-c8cdf39cdca5 service glance] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:25.530247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:25.531507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:25.531880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:25.532524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] PATH_INFO: `/v3/users/f9ffe0b326a946988cfa5550d044fa07` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:25.533575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ffe0b326a946988cfa5550d044fa07)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:25.536424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:25.628412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ffe0b326a946988cfa5550d044fa07'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.642722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ffe0b326a946988cfa5550d044fa07'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.643852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ffe0b326a946988cfa5550d044fa07'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.664492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ffe0b326a946988cfa5550d044fa07'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.676072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ffe0b326a946988cfa5550d044fa07'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:25.688829 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 976/1966] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:25 2022] DELETE /identity/v3/users/f9ffe0b326a946988cfa5550d044fa07 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:25.690648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:25.690941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:25.691220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:25.762970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:25.764585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:25.771043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:25.780660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:25.782160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:25.876068 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db6c8-927c-4ae8-9e45-8c1c9017bb33 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:25.895016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:25.898611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:25.899990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:25.902736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] PATH_INFO: `/v3/projects/f9f71660cdbb4915a13f5fd2d83b8a3c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:25.913092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f71660cdbb4915a13f5fd2d83b8a3c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:25.918708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:25.978094 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 991/1967] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:26.037377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f71660cdbb4915a13f5fd2d83b8a3c', 'request_id': 'req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.052099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f71660cdbb4915a13f5fd2d83b8a3c', 'request_id': 'req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.059523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f71660cdbb4915a13f5fd2d83b8a3c', 'request_id': 'req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.066306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.068618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.087531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] The token cache is being invalidate because project f9f71660cdbb4915a13f5fd2d83b8a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:26.087830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.089418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d08b5974-6ae7-4eb0-af72-ebeead0ec0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.098006 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 977/1968] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:25 2022] DELETE /identity/v3/projects/f9f71660cdbb4915a13f5fd2d83b8a3c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:26.100673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d3d2-9191-484f-8c4a-301ab8e68a1f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.101039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d3d2-9191-484f-8c4a-301ab8e68a1f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.105161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d3d2-9191-484f-8c4a-301ab8e68a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.154926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e162d3d2-9191-484f-8c4a-301ab8e68a1f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:26.157642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e162d3d2-9191-484f-8c4a-301ab8e68a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.269960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7edd9-36ec-4d5f-9010-1e4de386b91e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:26.328579 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 978/1969] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:26.330386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.330502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.330715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.381859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:26.383386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.394128 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 979/1970] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:26.404958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.432363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eb595-d5fb-490e-ac71-315e91e58906 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:26.443840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:26.444608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.444783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.445056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.445824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:26.446130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:26.448672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:26.467611 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 980/1971] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:26.469238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.471283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.477822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:26.478462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.478831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.479569 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.483766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.488685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ecb80-79dc-49e1-9c97-4cd8849814e8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:26.520635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:26.523263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:26.523671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.524312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.524758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] PATH_INFO: `/v3/users/49767009e14a4cc68b343474a071306b` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.525563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:26.530545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49767009e14a4cc68b343474a071306b)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:26.536591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:26.540187 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 992/1972] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:26.541029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.551892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:26.553666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edb794-5355-40df-a14e-f032e5176eec service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:26.559145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:26.560128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.560516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.560894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.561738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:26.565591 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:26.648889 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 993/1973] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:26 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:26.649981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.676803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49767009e14a4cc68b343474a071306b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.686590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:26.694202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49767009e14a4cc68b343474a071306b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.695360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49767009e14a4cc68b343474a071306b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.719564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49767009e14a4cc68b343474a071306b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.740323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-30f0d457-4f25-4980-a55c-4ed02889fb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49767009e14a4cc68b343474a071306b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:26.752738 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 981/1974] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:26 2022] DELETE /identity/v3/users/49767009e14a4cc68b343474a071306b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:26.759768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.760469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.760469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.782022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350002d2-5489-485c-99df-b95b072c5e43 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:26.810465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:26.811700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.919909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:26.920918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:26.921040 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:26.921365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:26.922751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:26.924676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:26.950395 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 982/1975] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:26.960019 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 994/1976] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:26 2022] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:26.966500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.968090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.971637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:26.973677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:26.983890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cec9ca-ab59-4241-ac78-37bd75306313 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.007407 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.008170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.008515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.008804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.009631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.012873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.032574 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 983/1977] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:27.034145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.062543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eb234-1fba-4612-8740-3c8ac36be202 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.091564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.092381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.092775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.101669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.102573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.104721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.110770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e4ea-4d00-48eb-b8e6-69db35ecd394 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.122337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ef18-19c5-4562-8a9a-dc6853d9c273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.123047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ef18-19c5-4562-8a9a-dc6853d9c273 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.123324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ef18-19c5-4562-8a9a-dc6853d9c273 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.123603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ef18-19c5-4562-8a9a-dc6853d9c273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.125307 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 984/1978] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:27.130695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.155225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04f47-a08d-4f9c-be10-15ea4cb526e0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.165304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ef18-19c5-4562-8a9a-dc6853d9c273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.169165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ef18-19c5-4562-8a9a-dc6853d9c273 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.172478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.173667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.174782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.175182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] PATH_INFO: `/v3/projects/5810032c071b44b39c02a9f96eac6524/users/dc9ce687add341edaf862b3e23173264/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.186966 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 995/1979] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:27.205266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5810032c071b44b39c02a9f96eac6524, user_id=dc9ce687add341edaf862b3e23173264, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.208384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.227163 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 985/1980] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:27 2022] PUT /identity/v3/projects/5810032c071b44b39c02a9f96eac6524/users/dc9ce687add341edaf862b3e23173264/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:27.240098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.240899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.241108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.311343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] MFA Rules not processed for user `dc9ce687add341edaf862b3e23173264`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:27.312611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:27.379658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:27.410640 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 996/1981] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:27.415050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.530767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:27.562188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb6ba2-33a8-4c0e-bab6-19a102dea75e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.568607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.570179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.570600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.571121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.572415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.579017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.627779 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 986/1982] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:27 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:27.631960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.650577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdfbb7-695e-4f05-b803-e6d35038f9ed None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.840870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.841618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.841906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.842185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.842892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.845223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.891194 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 997/1983] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:27 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:27.892990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.917384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575343d-587f-4c7c-933e-033d1278fc2a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.926007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.927231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.927747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.928233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.929520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.931554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:27.954737 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 987/1984] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:27.955521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.975546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c31c-306e-470f-a4c4-76b4f5796c0f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:27.991276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:27.992197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:27.992757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:27.993792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:27.993978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:27.996822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:27.999542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.001953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:28.013547 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 998/1985] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:28.017336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:28.030210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bbff-8621-4518-b699-b3be8616c876 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:28.034548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb42cd-c3e9-4395-94c6-f35e162b3704 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:28.038019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b4ec3-2773-4db6-8330-c4805af456f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:28.041132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b4ec3-2773-4db6-8330-c4805af456f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.041132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b4ec3-2773-4db6-8330-c4805af456f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.041132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b4ec3-2773-4db6-8330-c4805af456f4 admin admin] PATH_INFO: `/v3/projects/1cd3302fa4ed4b3c80692bc28cb761d2/users/27318b469d7049fe90aab1e9bb36734e/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.048260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:28.053793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.053793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.053793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] PATH_INFO: `/v3/projects/a3ec7209aa744736a794511914b33b50` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.056464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ec7209aa744736a794511914b33b50)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:28.062712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.074034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b4ec3-2773-4db6-8330-c4805af456f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd3302fa4ed4b3c80692bc28cb761d2, user_id=27318b469d7049fe90aab1e9bb36734e, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:28.077054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b4ec3-2773-4db6-8330-c4805af456f4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.100588 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 999/1986] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:28 2022] PUT /identity/v3/projects/1cd3302fa4ed4b3c80692bc28cb761d2/users/27318b469d7049fe90aab1e9bb36734e/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:28.112640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.113098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.113486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.179253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] MFA Rules not processed for user `27318b469d7049fe90aab1e9bb36734e`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:28.180598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:28.188349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ec7209aa744736a794511914b33b50', 'request_id': 'req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.204211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ec7209aa744736a794511914b33b50', 'request_id': 'req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.221614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ec7209aa744736a794511914b33b50', 'request_id': 'req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.260434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] The token cache is being invalidate because project a3ec7209aa744736a794511914b33b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:28.260841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.262651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.265178 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 988/1987] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:27 2022] DELETE /identity/v3/projects/a3ec7209aa744736a794511914b33b50 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:28.269351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:28.271195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:28.352201 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1000/1988] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:28.354857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:28.356720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:28.407180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fd4fa-7d5a-4e09-928d-ed062e4d4573 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:28.430640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:28.431861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.432336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.433542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] PATH_INFO: `/v3/users/d556392888cc48fda2425239571712e2` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.434989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d556392888cc48fda2425239571712e2)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:28.437523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.478909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:28.509000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:28.523495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd556392888cc48fda2425239571712e2'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.536013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd556392888cc48fda2425239571712e2'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.536272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88fa4b-c616-4f9b-8157-d217f5bc0fce None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:28.537055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd556392888cc48fda2425239571712e2'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.542308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:28.542992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.543277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.543560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.544271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:28.546822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.559451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd556392888cc48fda2425239571712e2'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.571838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd556392888cc48fda2425239571712e2'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:28.613031 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 989/1989] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:28 2022] DELETE /identity/v3/users/d556392888cc48fda2425239571712e2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:28.616161 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1001/1990] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:28 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:28.618980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:28.624784 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:28.778705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196d3c6-00dd-400f-b0c9-dd93489821b2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:28.794643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:28.795972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.796530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.797344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.799044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:28.805591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.846002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:28.848783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:28.873765 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 990/1991] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:28 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:28.876832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:28.919359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19dd4d-7726-4725-b98c-aa808b580b48 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:28.935041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:28.937157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:28.937157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:28.938120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:28.940018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:28.941723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:28.980949 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 991/1992] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:28.983299 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:29.018896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8b3af-e181-4e16-8029-5113e2f99aa4 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:29.028604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:29.029578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:29.029871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:29.030155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] PATH_INFO: `/v3/projects/09f643a4449349e8bc603614f85768d4/users/01780a5c7cb74c56af380aad57245a1b/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:29.039746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f4d96-9d85-4c19-a06d-434213e9c9e1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:29.059331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:29.060715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:29.061134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:29.061575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] PATH_INFO: `/v3/projects/e5c9312c36524934870ccbb4a59b78d7` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:29.063113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c9312c36524934870ccbb4a59b78d7)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:29.066953 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:29.082531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f643a4449349e8bc603614f85768d4, user_id=01780a5c7cb74c56af380aad57245a1b, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:29.092462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:29.112350 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 992/1993] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:28 2022] PUT /identity/v3/projects/09f643a4449349e8bc603614f85768d4/users/01780a5c7cb74c56af380aad57245a1b/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:29.125083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:29.236574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c9312c36524934870ccbb4a59b78d7', 'request_id': 'req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.258764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c9312c36524934870ccbb4a59b78d7', 'request_id': 'req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.277047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c9312c36524934870ccbb4a59b78d7', 'request_id': 'req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.298536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] The token cache is being invalidate because project e5c9312c36524934870ccbb4a59b78d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:29.298827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.299921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdcd4e-b6d9-4ae8-b7d1-83c06f88ca10 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:29.308895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.318255 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1002/1994] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:28 2022] DELETE /identity/v3/projects/e5c9312c36524934870ccbb4a59b78d7 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:29.324502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:29.325721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:29.353506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:29.470378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:29.501879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b86ec-c8ae-48dd-adc8-3020d9d8126a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:29.516203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:29.516986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:29.517300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:29.517578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:29.518788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:29.520779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:29.527823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:29.528774 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:29.529080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:29.529396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] PATH_INFO: `/v3/users/857a87dd165a4db8a88a266febfcdbea` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:29.534082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857a87dd165a4db8a88a266febfcdbea)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:29.536084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:29.563770 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 993/1995] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:29.564609 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:29.566514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:29.581278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1787-c4ce-4330-ad12-7cb09182a98f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:29.586820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:29.587843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:29.588421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:29.588832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] PATH_INFO: `/v3/users/ba74f13f2a1e445dab34258d50ec8012` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:29.590605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba74f13f2a1e445dab34258d50ec8012)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:29.595047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:29.657486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857a87dd165a4db8a88a266febfcdbea'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.677567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857a87dd165a4db8a88a266febfcdbea'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.679509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857a87dd165a4db8a88a266febfcdbea'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.698991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba74f13f2a1e445dab34258d50ec8012'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.700891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857a87dd165a4db8a88a266febfcdbea'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.702391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857a87dd165a4db8a88a266febfcdbea'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.715451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba74f13f2a1e445dab34258d50ec8012'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.722226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba74f13f2a1e445dab34258d50ec8012'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.742853 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1003/1996] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:29 2022] DELETE /identity/v3/users/857a87dd165a4db8a88a266febfcdbea => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:29.743838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:29.745837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:29.763161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba74f13f2a1e445dab34258d50ec8012'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.779271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba74f13f2a1e445dab34258d50ec8012'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:29.789062 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 994/1997] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:29 2022] DELETE /identity/v3/users/ba74f13f2a1e445dab34258d50ec8012 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:29.790165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:29.792661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:29.900219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376f25-68f4-4f89-b4de-619b76280393 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:29.999077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d2d9-f293-4205-b1b0-09c4a2e98a39 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:30.011564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.014959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.017290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.017502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ef298-5557-4769-8a55-c7df31e499c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.018055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] PATH_INFO: `/v3/projects/c682698f1bda431cb96547d927a5080d` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.018618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ef298-5557-4769-8a55-c7df31e499c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.018911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ef298-5557-4769-8a55-c7df31e499c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.019193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ef298-5557-4769-8a55-c7df31e499c9 admin admin] PATH_INFO: `/v3/projects/09f643a4449349e8bc603614f85768d4/users/01780a5c7cb74c56af380aad57245a1b/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.022792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c682698f1bda431cb96547d927a5080d)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.023950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ef298-5557-4769-8a55-c7df31e499c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f643a4449349e8bc603614f85768d4, user_id=01780a5c7cb74c56af380aad57245a1b, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.026847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.035428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ef298-5557-4769-8a55-c7df31e499c9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.049777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:30.063996 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 995/1998] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:29 2022] PUT /identity/v3/projects/09f643a4449349e8bc603614f85768d4/users/01780a5c7cb74c56af380aad57245a1b/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:30.076989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685b14-4d05-4e78-87dc-473ea0d0925c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.077378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685b14-4d05-4e78-87dc-473ea0d0925c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.077909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685b14-4d05-4e78-87dc-473ea0d0925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.126200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c682698f1bda431cb96547d927a5080d', 'request_id': 'req-7ea440bb-5036-44bf-8ffe-c69ded6d645d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.159428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c682698f1bda431cb96547d927a5080d', 'request_id': 'req-7ea440bb-5036-44bf-8ffe-c69ded6d645d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.163129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-09685b14-4d05-4e78-87dc-473ea0d0925c None None] MFA Rules not processed for user `01780a5c7cb74c56af380aad57245a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.164381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-09685b14-4d05-4e78-87dc-473ea0d0925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.180413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c682698f1bda431cb96547d927a5080d', 'request_id': 'req-7ea440bb-5036-44bf-8ffe-c69ded6d645d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.189739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:30.210447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] The token cache is being invalidate because project c682698f1bda431cb96547d927a5080d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:30.211013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.212018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.214407 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1004/1999] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:29 2022] DELETE /identity/v3/projects/c682698f1bda431cb96547d927a5080d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:30.219092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:30.220890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.292587 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 996/2000] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:30.294339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.294992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.295343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.325503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.327070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.335055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea440bb-5036-44bf-8ffe-c69ded6d645d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:30.352274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.354285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.354776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.355114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] PATH_INFO: `/v3/projects/e5d4c3ce33db4711835456d22e7bfdbb` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.356466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d4c3ce33db4711835456d22e7bfdbb)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.357338 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 997/2001] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:30.358395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:30.360452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.360560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.436924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d4c3ce33db4711835456d22e7bfdbb', 'request_id': 'req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.446795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d4c3ce33db4711835456d22e7bfdbb', 'request_id': 'req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.458663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cd857-fe8e-47c6-b87f-2f3bebbeabf6 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:30.459828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d4c3ce33db4711835456d22e7bfdbb', 'request_id': 'req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.503817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] The token cache is being invalidate because project e5d4c3ce33db4711835456d22e7bfdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:30.504448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.504922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9a6b0f70-f386-427a-b43a-c2a9e68ba6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.511545 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1005/2002] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:30 2022] DELETE /identity/v3/projects/e5d4c3ce33db4711835456d22e7bfdbb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:30.515137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.515857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.515857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.553132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.554576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.566182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.566866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.567154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.567440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.569542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.591088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:30.643827 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1006/2003] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:30.643827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:30.643827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.657062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6d3a-c95f-4de1-a07b-bf80e85e5b1d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:30.662541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.663706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.664188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.664655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] PATH_INFO: `/v3/projects/e00936b011c54653b78087b1b52e4680` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.666119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00936b011c54653b78087b1b52e4680)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.668781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.683821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.684095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d7978-39cf-4b4a-a05c-c4dbe60aa1be service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.694976 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 998/2004] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:30.696543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab696f91-0dda-4fdb-a1dc-a31304490f5f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.696729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab696f91-0dda-4fdb-a1dc-a31304490f5f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.697110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab696f91-0dda-4fdb-a1dc-a31304490f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.708406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:30.725455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ab696f91-0dda-4fdb-a1dc-a31304490f5f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.726874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ab696f91-0dda-4fdb-a1dc-a31304490f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.737696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00936b011c54653b78087b1b52e4680', 'request_id': 'req-e2457c1c-f492-49ca-9f99-bf1da87f53d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.750117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00936b011c54653b78087b1b52e4680', 'request_id': 'req-e2457c1c-f492-49ca-9f99-bf1da87f53d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.762048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00936b011c54653b78087b1b52e4680', 'request_id': 'req-e2457c1c-f492-49ca-9f99-bf1da87f53d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.798217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] The token cache is being invalidate because project e00936b011c54653b78087b1b52e4680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:30.798512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.800478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:30.803132 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1007/2005] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:30 2022] DELETE /identity/v3/projects/e00936b011c54653b78087b1b52e4680 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:30.806345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:30.811677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.855086 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 999/2006] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:30.859148 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9e6b-fbb0-4140-a57c-8cf2dc8e798a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.859943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9e6b-fbb0-4140-a57c-8cf2dc8e798a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.860649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9e6b-fbb0-4140-a57c-8cf2dc8e798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.888830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d39d9e6b-fbb0-4140-a57c-8cf2dc8e798a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.890410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d39d9e6b-fbb0-4140-a57c-8cf2dc8e798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.909352 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1000/2007] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:30.910660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.911134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.911476 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.914982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2457c1c-f492-49ca-9f99-bf1da87f53d3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:30.926803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.927528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.927917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.928276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.928778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:30.929372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.930763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cc51a-37b9-4acf-af57-4b2bbb6cb503 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.943059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.944361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.945250 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1008/2008] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:30.946570 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.946861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.947145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.957661 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1001/2009] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:30.958671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:30.971533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb40ce-9d6b-495a-8187-b6fa1fac8dfb None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:30.974804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:30.976023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:30.976573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:30.977701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:30.978085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:30.978386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:30.979671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:30.982037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:30.990570 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1009/2010] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:30.991668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.003300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64fd9-69e6-47a7-9cbc-23181848a8c5 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.012652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.013282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.013560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.014211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.014571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:31.014879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.016519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.019733 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1002/2011] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:30 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:31.020544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.046418 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1010/2012] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:31.047242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.068664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281c10-c613-4e61-a279-c719fe511b2d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.118301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:31.127032 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709a62e-2ea1-4012-8405-60f169b932b9 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.134786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.135709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.135997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.136285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.137702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:31.137984 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.140628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.159324 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1003/2013] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:31.159324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.164974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.165763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.166046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.166970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.167869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.170037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.176544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92acf9-bd97-46f1-920c-5b8ea00617e2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.188500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.189347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.189638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.190673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.191432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.193696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.200568 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1011/2014] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:31.201496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.215362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd1f7-3cd6-4c19-aeee-9ed376c0ad4b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.221542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.222204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.222829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.222959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.223587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.225889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.233980 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1004/2015] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:31.234849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.262236 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1012/2016] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:31.262236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.299836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:31.325031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767288d-4566-4674-9226-1680cff8b1f6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.378098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf45baf-7d20-4daf-ad13-f15accbd9983 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.387791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.388511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.388804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.389111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.389842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.391940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.402274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.402274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.402274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.402274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.403455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.406249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.418086 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1013/2017] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:31.419800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.422214 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1005/2018] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:31.423309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.433794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eb096-8fb6-4d7b-aa4e-58e3c2853821 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.433980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856440-ad12-408f-abea-f4b4876fd49c admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.439502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.440426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.440560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.440813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.441169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.441268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.441457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.442187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.443933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.444447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.445200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.447265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.458448 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1006/2019] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:31.458448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.470420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286172d8-d509-4cb0-be8c-a9ebd8197388 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.476506 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1014/2020] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:31.476506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.477752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:31.478472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.480135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.480448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.480752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.481519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.484633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.496090 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1007/2021] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:31.497052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.511071 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e93e1-b7c5-478b-b007-7c6e287e4164 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.518923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.520151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.520419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.520745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.521659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.523687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.536500 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1008/2022] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:31.537320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.550472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e5210-c46f-46bb-8903-2cca72f67858 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.555198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.555864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.556202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.556518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18984041-e164-4296-a44d-98bb608f55aa admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.557094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.557322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.559317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.560482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.561174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.561472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.561752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.565176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:31.570675 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1009/2023] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:31.573511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.584871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df7c0-8290-4835-bd5f-c009b5135793 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.592142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.593036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.593356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.593899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] PATH_INFO: `/v3/projects/41136db04875436c847dfc1e98f8109e/users/023a0f5d71d94a1d830e20306e3ce45a/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.595523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:31.611388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41136db04875436c847dfc1e98f8109e, user_id=023a0f5d71d94a1d830e20306e3ce45a, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.614097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.628171 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1010/2024] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:31 2022] PUT /identity/v3/projects/41136db04875436c847dfc1e98f8109e/users/023a0f5d71d94a1d830e20306e3ce45a/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:31.629094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.640042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.641582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.651577 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1015/2025] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:31.652389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.666554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ddba7-d717-4f77-bcde-93b78466111a service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.712501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04413d9-323b-4ef6-b244-12228c710e04 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.721516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.722237 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.722524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.722789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] PATH_INFO: `/v3/projects/3433fceb10214afcbc819edcec864651/users/e90f349f384245fb8a118be176ad6829/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.736464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8021527-591f-4515-b8fc-1e3fc86a6229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.737175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8021527-591f-4515-b8fc-1e3fc86a6229 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.737453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8021527-591f-4515-b8fc-1e3fc86a6229 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.737777 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8021527-591f-4515-b8fc-1e3fc86a6229 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.738482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8021527-591f-4515-b8fc-1e3fc86a6229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.740121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8021527-591f-4515-b8fc-1e3fc86a6229 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.741525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3433fceb10214afcbc819edcec864651, user_id=e90f349f384245fb8a118be176ad6829, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.744462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.757091 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1016/2026] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:31.757091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f42a-b71a-41ee-a913-18a7109ae34e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.757091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f42a-b71a-41ee-a913-18a7109ae34e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.757091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f42a-b71a-41ee-a913-18a7109ae34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.762451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:31.771368 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1011/2027] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:31 2022] PUT /identity/v3/projects/3433fceb10214afcbc819edcec864651/users/e90f349f384245fb8a118be176ad6829/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:31.772488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.803981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-86c2f42a-b71a-41ee-a913-18a7109ae34e None None] MFA Rules not processed for user `023a0f5d71d94a1d830e20306e3ce45a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:31.806011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-86c2f42a-b71a-41ee-a913-18a7109ae34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:31.861242 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9fddb-55dc-4483-8405-0d6b90ac4556 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:31.866119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:31.867018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.867376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.867584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] PATH_INFO: `/v3/projects/8d2a22dd9aa44fe185bbf0f3d86b76a3/users/23d1d1bd2160471b829a9263e2c51fe8/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.887110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2a22dd9aa44fe185bbf0f3d86b76a3, user_id=23d1d1bd2160471b829a9263e2c51fe8, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:31.890145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:31.893899 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1017/2028] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:31.899028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ae091-9e8b-4fa9-b6de-61fef02a3f99 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:31.899638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ae091-9e8b-4fa9-b6de-61fef02a3f99 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:31.900122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ae091-9e8b-4fa9-b6de-61fef02a3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:31.914791 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1012/2029] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:31 2022] PUT /identity/v3/projects/8d2a22dd9aa44fe185bbf0f3d86b76a3/users/23d1d1bd2160471b829a9263e2c51fe8/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:31.915504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:31.922488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-218ae091-9e8b-4fa9-b6de-61fef02a3f99 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:31.923399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-218ae091-9e8b-4fa9-b6de-61fef02a3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:32.005315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:32.007390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf111-813b-46d0-bcc8-99a4eb362129 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.014126 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.015024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.015392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.015675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.016387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.018920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.033244 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1018/2030] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:32.033244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.033244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.033244 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.054398 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1013/2031] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:31 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:32.057393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.058640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:32.070980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] MFA Rules not processed for user `23d1d1bd2160471b829a9263e2c51fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:32.071807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:32.132252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b54c24-7209-4455-b30f-e9f7ccb499de admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.136042 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.137235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.137522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.137797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.147257 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1019/2032] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:32.148099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.164439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:32.211414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.213807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.219166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc4602-0e78-4c7e-8262-d99560a023e0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.224237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.225122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.225410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.225668 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1014/2033] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:32.225772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.226512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.230653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.233993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.267196 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1020/2034] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:32 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:32.271338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.288529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3253a-6398-474d-a4d4-1b1d674f9dcd admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.302320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.303316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.304269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.304559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.305654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.307656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.317796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8f931-1d73-4dd4-84a0-a71e854b3337 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.321213 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1021/2035] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:32.323509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.324047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.324473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.324915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.326461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.344579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.349415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b179981-998b-4947-8dc2-6a9461de1fc3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.350321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.355515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.356763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.357053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.357485 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] PATH_INFO: `/v3/projects/cd60b829d9004c8ba2b27bf3f964a7f8/users/5160af906a2245fb8010f7f504f4731f/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.367110 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1015/2036] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:32.387014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd60b829d9004c8ba2b27bf3f964a7f8, user_id=5160af906a2245fb8010f7f504f4731f, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.390988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.415473 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1022/2037] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:32 2022] PUT /identity/v3/projects/cd60b829d9004c8ba2b27bf3f964a7f8/users/5160af906a2245fb8010f7f504f4731f/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:32.419839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.435072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ded65-0f12-4ca5-9fb2-54989725573a service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.552491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc82fd-be80-41a2-a528-9c6c1ce5f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.553535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc82fd-be80-41a2-a528-9c6c1ce5f8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.554035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc82fd-be80-41a2-a528-9c6c1ce5f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.554656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc82fd-be80-41a2-a528-9c6c1ce5f8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.555443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc82fd-be80-41a2-a528-9c6c1ce5f8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.557518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc82fd-be80-41a2-a528-9c6c1ce5f8e1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.582249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.594164 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1016/2038] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:32.599442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b498-eb18-452b-b88d-285744da3f84 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:32.617187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:32.617187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.617187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.617496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] PATH_INFO: `/v3/projects/cd60b829d9004c8ba2b27bf3f964a7f8/users/5160af906a2245fb8010f7f504f4731f/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.620726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd60b829d9004c8ba2b27bf3f964a7f8, user_id=5160af906a2245fb8010f7f504f4731f, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:32.623604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:32.640603 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1023/2039] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:32 2022] PUT /identity/v3/projects/cd60b829d9004c8ba2b27bf3f964a7f8/users/5160af906a2245fb8010f7f504f4731f/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:32.667582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:32.668351 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:32.668905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:32.812109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] MFA Rules not processed for user `5160af906a2245fb8010f7f504f4731f`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:32.813549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:32.897470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:32.931144 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1017/2040] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:32.945293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:32.947144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:32.976263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:33.014931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63464b6e-54ab-444c-83e2-9d02baa48869 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:33.018549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:33.019200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:33.019480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:33.019755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:33.030445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:33.031969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:33.043086 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1024/2041] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:33.153573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:33.165570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98f1c-a02a-4219-b990-9c9df1e9dd8b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:33.170315 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38673b-4d7a-4a1e-b1c2-6a541974a4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:33.170977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38673b-4d7a-4a1e-b1c2-6a541974a4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:33.171264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38673b-4d7a-4a1e-b1c2-6a541974a4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:33.171556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38673b-4d7a-4a1e-b1c2-6a541974a4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:33.269963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38673b-4d7a-4a1e-b1c2-6a541974a4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:33.271980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38673b-4d7a-4a1e-b1c2-6a541974a4e7 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:33.289363 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1018/2042] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:36.551041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:36.566243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f045-1338-4fb3-8623-4b744ef7c041 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:36.579771 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:36.583420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:36.583420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:36.583646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:36.586954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:36.684436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:36.686579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc69a7-2d4c-4d86-abdf-ec75f0549fef service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:36.700243 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1025/2043] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:38.315052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:38.315662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:38.315801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:38.363749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] MFA Rules not processed for user `e90f349f384245fb8a118be176ad6829`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:38.365054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:38.444152 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1019/2044] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:38.456095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:38.457036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:38.457345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:38.480533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] MFA Rules not processed for user `e90f349f384245fb8a118be176ad6829`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:38.481802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:38.488901 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1026/2045] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:38.502772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:38.504796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:38.592656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091ebd-002f-40f3-878e-f70a6722e0a9 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:38.598661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820aaa3-1633-4f33-8571-fb9cfd64503e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:38.599388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820aaa3-1633-4f33-8571-fb9cfd64503e service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:38.599711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820aaa3-1633-4f33-8571-fb9cfd64503e service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:38.599996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820aaa3-1633-4f33-8571-fb9cfd64503e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:38.606629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:38.609477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820aaa3-1633-4f33-8571-fb9cfd64503e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:38.611441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820aaa3-1633-4f33-8571-fb9cfd64503e service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:38.622910 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1020/2046] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:38.953328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:39.047643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb01f2-dbd9-4459-96c5-e4857a34b39a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:39.053544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:39.054654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:39.054999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:39.055399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] PATH_INFO: `/v3/users/23d1d1bd2160471b829a9263e2c51fe8` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:39.056811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d1d1bd2160471b829a9263e2c51fe8)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:39.059142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:39.125348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d1d1bd2160471b829a9263e2c51fe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.133439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d1d1bd2160471b829a9263e2c51fe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.134022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d1d1bd2160471b829a9263e2c51fe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.138364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:39.146713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d1d1bd2160471b829a9263e2c51fe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.147835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-36cf8531-51e1-46f3-b17c-94afa8e93338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d1d1bd2160471b829a9263e2c51fe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.188527 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1027/2047] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:38 2022] DELETE /identity/v3/users/23d1d1bd2160471b829a9263e2c51fe8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:39.189623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:39.189838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:39.190120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:39.234852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:39.238308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:39.403470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9331-0c3e-46ba-8197-d449dadb1e78 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:39.410764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9331-0c3e-46ba-8197-d449dadb1e78 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:39.411059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9331-0c3e-46ba-8197-d449dadb1e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:39.437229 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1021/2048] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:39.449797 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:39.451506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:39.476667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3c7f9331-0c3e-46ba-8197-d449dadb1e78 None None] MFA Rules not processed for user `e90f349f384245fb8a118be176ad6829`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:39.490408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3c7f9331-0c3e-46ba-8197-d449dadb1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:39.558532 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884edc3-7a15-4aca-a921-15398b0b3003 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:39.566254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:39.567147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:39.567885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:39.567885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:39.595417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:39.596993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:39.619788 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1022/2049] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:39.641073 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1028/2050] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:39.757813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:39.760806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:39.776289 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7cb5e-ce80-42e9-af1c-6b8415ea5364 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:39.782442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:39.783481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:39.783837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:39.784186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] PATH_INFO: `/v3/users/023a0f5d71d94a1d830e20306e3ce45a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:39.785691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023a0f5d71d94a1d830e20306e3ce45a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:39.787884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:39.886996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023a0f5d71d94a1d830e20306e3ce45a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.903588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023a0f5d71d94a1d830e20306e3ce45a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.904498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023a0f5d71d94a1d830e20306e3ce45a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.934171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023a0f5d71d94a1d830e20306e3ce45a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.969422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023a0f5d71d94a1d830e20306e3ce45a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:39.986780 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1023/2051] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:39 2022] DELETE /identity/v3/users/023a0f5d71d94a1d830e20306e3ce45a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:40.000181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:40.000181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:40.000181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:40.041799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:40.043030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.077999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:40.079556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.109772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:40.194302 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1029/2052] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:40.221650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101418-eea5-4ee1-98ce-88e287315013 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:40.228297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:40.232557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:40.233020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:40.233334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:40.233663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] PATH_INFO: `/v3/users/dc9ce687add341edaf862b3e23173264` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:40.234982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.235192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9ce687add341edaf862b3e23173264)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:40.237213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:40.307362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9ce687add341edaf862b3e23173264'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.315480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9ce687add341edaf862b3e23173264'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.319448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9ce687add341edaf862b3e23173264'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.346484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9ce687add341edaf862b3e23173264'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.363924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9ce687add341edaf862b3e23173264'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.382432 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1024/2053] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:40 2022] DELETE /identity/v3/users/dc9ce687add341edaf862b3e23173264 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:40.388378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:40.390794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2faf6-65a4-4b6c-84a3-e3ac3d3e92a2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:40.391046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.466831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:40.529853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:40.531769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:40.532302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:40.532879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:40.538070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.581967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765446-d810-4807-b821-ae9fca086310 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:40.596300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:40.598320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:40.599592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:40.599894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] PATH_INFO: `/v3/projects/8d2a22dd9aa44fe185bbf0f3d86b76a3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:40.603041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2a22dd9aa44fe185bbf0f3d86b76a3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:40.605508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:40.654506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:40.671974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fa24c-23ff-405e-bb9f-70de2b09ad9e service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:40.697746 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1030/2054] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:40.698440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:40.699319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:40.699589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:40.699862 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:40.722548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:40.723775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.727283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2a22dd9aa44fe185bbf0f3d86b76a3', 'request_id': 'req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.738303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2a22dd9aa44fe185bbf0f3d86b76a3', 'request_id': 'req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.765851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2a22dd9aa44fe185bbf0f3d86b76a3', 'request_id': 'req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.787601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] The token cache is being invalidate because project 8d2a22dd9aa44fe185bbf0f3d86b76a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:40.787901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.788686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9e1f03b6-ee31-4038-86f6-c2cf1471a9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:40.791395 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1025/2055] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:40 2022] DELETE /identity/v3/projects/8d2a22dd9aa44fe185bbf0f3d86b76a3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:40.800513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b155-4b77-4ec1-8698-6de3b1765070 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:40.800813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b155-4b77-4ec1-8698-6de3b1765070 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:40.801157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b155-4b77-4ec1-8698-6de3b1765070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:40.835383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-75c8b155-4b77-4ec1-8698-6de3b1765070 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:40.838067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-75c8b155-4b77-4ec1-8698-6de3b1765070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:40.861500 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1031/2056] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:40.869919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:40.878644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:41.012065 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1026/2057] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:41.022791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf736f9-15ac-4610-af19-4c07b5650513 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.025103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.026956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.027449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.027868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.028518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.028883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.029247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.043332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.045076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.070623 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1032/2058] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:41.077799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:41.078971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:41.096303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.110664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b59f9-4547-4c66-982a-c11c5d910824 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.111220 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1027/2059] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:41.116750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.117521 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.117975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.118312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.119584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:41.120140 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.123278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.145463 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1033/2060] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:41.146314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.160040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119b6d6-e5ce-4ef7-9831-7f643e6f2e4f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.185950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.186640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.186949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.187216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.187920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.193727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.274616 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1028/2061] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:41 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:41.279716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.295503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb9d4-9e2e-45e4-8ae5-01bd88eb5d8f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.320568 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:41.434723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.435458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.436250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.436540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.437289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.443958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.445437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.448801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:41.489871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a15b-99f7-4432-b7f0-459b6a10dba8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.498654 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1034/2062] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:41 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:41.511722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.519736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.522862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.523442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.524070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] PATH_INFO: `/v3/projects/41136db04875436c847dfc1e98f8109e` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.529994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41136db04875436c847dfc1e98f8109e)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.534044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.550208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be8ba-5caf-4d6a-b320-8f28dad6177d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.559907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.561601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.562130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.562748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.563937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.566523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.583020 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1035/2063] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:41.610344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.627425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe623-2062-4326-b3b1-22205156a80f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.669742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41136db04875436c847dfc1e98f8109e', 'request_id': 'req-93fbb6c1-5ab1-44b0-89c8-433d899b8317'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:41.684262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41136db04875436c847dfc1e98f8109e', 'request_id': 'req-93fbb6c1-5ab1-44b0-89c8-433d899b8317'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:41.699656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41136db04875436c847dfc1e98f8109e', 'request_id': 'req-93fbb6c1-5ab1-44b0-89c8-433d899b8317'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:41.725020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] The token cache is being invalidate because project 41136db04875436c847dfc1e98f8109e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:41.725425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:41.727336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:41.736507 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1029/2064] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:41 2022] DELETE /identity/v3/projects/41136db04875436c847dfc1e98f8109e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:41.737528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.739158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:41.767355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.768045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.768326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.771032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.771939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.776201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.784763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:41.804898 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1036/2065] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:41.810030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.817746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:41.854131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdd89d-4cfb-496b-bbb3-b8447a649ee1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.873515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:41.874524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:41.874877 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:41.875222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] PATH_INFO: `/v3/projects/fb15ac0c70bf4abc952254fa20f8a4f9/users/224d2921875a4fb281f47b56385546d3/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:41.914420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb15ac0c70bf4abc952254fa20f8a4f9, user_id=224d2921875a4fb281f47b56385546d3, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:41.920029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:41.961244 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1037/2066] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:41 2022] PUT /identity/v3/projects/fb15ac0c70bf4abc952254fa20f8a4f9/users/224d2921875a4fb281f47b56385546d3/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:41.962099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:41.987079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbb6c1-5ab1-44b0-89c8-433d899b8317 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:41.988826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:42.110929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:42.111939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:42.111939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:42.112252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] PATH_INFO: `/v3/users/5160af906a2245fb8010f7f504f4731f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:42.113806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5160af906a2245fb8010f7f504f4731f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:42.116039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:42.148246 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8020eb1-4f3f-4557-b28a-e77d8f0f1c24 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:42.162279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:42.163157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:42.163439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:42.163747 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] PATH_INFO: `/v3/projects/5810032c071b44b39c02a9f96eac6524` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:42.165279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5810032c071b44b39c02a9f96eac6524)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:42.168278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:42.197059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:42.204125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5160af906a2245fb8010f7f504f4731f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.229364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5160af906a2245fb8010f7f504f4731f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.230190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5160af906a2245fb8010f7f504f4731f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.262787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5160af906a2245fb8010f7f504f4731f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.264413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5810032c071b44b39c02a9f96eac6524', 'request_id': 'req-7f4d0996-6e27-4fc5-8895-b5e23575cec1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.272424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5810032c071b44b39c02a9f96eac6524', 'request_id': 'req-7f4d0996-6e27-4fc5-8895-b5e23575cec1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.280987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5810032c071b44b39c02a9f96eac6524', 'request_id': 'req-7f4d0996-6e27-4fc5-8895-b5e23575cec1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.288353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76227830-a335-4421-b698-9d28220ccd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5160af906a2245fb8010f7f504f4731f'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.302614 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1030/2067] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:41 2022] DELETE /identity/v3/users/5160af906a2245fb8010f7f504f4731f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:42.304297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] The token cache is being invalidate because project 5810032c071b44b39c02a9f96eac6524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:42.304611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.305388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.307112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:42.307523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:42.308015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:42.312820 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1038/2068] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:41 2022] DELETE /identity/v3/projects/5810032c071b44b39c02a9f96eac6524 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:42.314010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:42.316447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:42.373661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] MFA Rules not processed for user `224d2921875a4fb281f47b56385546d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:42.374978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:42.431442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0996-6e27-4fc5-8895-b5e23575cec1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:42.476066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:42.548139 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1031/2069] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:42.548139 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:42.558055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:42.600873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:42.607249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:42.608711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:42.609750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] PATH_INFO: `/v3/users/27318b469d7049fe90aab1e9bb36734e` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:42.628693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27318b469d7049fe90aab1e9bb36734e)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:42.636545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:42.752218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139be923-9211-45dc-a6f1-42c89b1bee54 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:42.771794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:42.777438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:42.778511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:42.780280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] PATH_INFO: `/v3/users/c8653fd1cf1640188ca284102eae0b56` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:42.784762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8653fd1cf1640188ca284102eae0b56)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:42.787491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:42.819674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27318b469d7049fe90aab1e9bb36734e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.821156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:42.836253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27318b469d7049fe90aab1e9bb36734e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.837332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27318b469d7049fe90aab1e9bb36734e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.861511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27318b469d7049fe90aab1e9bb36734e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.862954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27318b469d7049fe90aab1e9bb36734e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.916472 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1039/2070] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:42 2022] DELETE /identity/v3/users/27318b469d7049fe90aab1e9bb36734e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:42.919394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:42.920922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8653fd1cf1640188ca284102eae0b56'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.923013 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:42.937713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8653fd1cf1640188ca284102eae0b56'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.939036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8653fd1cf1640188ca284102eae0b56'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.971381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8653fd1cf1640188ca284102eae0b56'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:42.989557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ea832178-1020-4c95-8be1-3863b067fb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8653fd1cf1640188ca284102eae0b56'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:43.019433 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1032/2071] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:42 2022] DELETE /identity/v3/users/c8653fd1cf1640188ca284102eae0b56 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:43.021342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:43.021979 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:43.022365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:43.063588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:43.065801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:43.089070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a15b-0b64-4d32-93ad-8061801c49e1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:43.182689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:43.221000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:43.222090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:43.222872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:43.223354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:43.229844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:43.236412 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1033/2072] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:43.253634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:43.256176 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:43.395082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:43.396560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:43.411822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c1cd-a43f-4eab-a3c3-08b8d870e234 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:43.415514 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1040/2073] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:43.429909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:43.435443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb92ef-5cfc-4ab6-b09e-6d08a70fc4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:43.436112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb92ef-5cfc-4ab6-b09e-6d08a70fc4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:43.436398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb92ef-5cfc-4ab6-b09e-6d08a70fc4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:43.436672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb92ef-5cfc-4ab6-b09e-6d08a70fc4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:43.437329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:43.482125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb92ef-5cfc-4ab6-b09e-6d08a70fc4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:43.486789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb92ef-5cfc-4ab6-b09e-6d08a70fc4c3 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:43.501625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bf61-b94b-470e-a5d8-02b82db8b129 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:43.513779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:43.514679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:43.517064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:43.517548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] PATH_INFO: `/v3/projects/cd60b829d9004c8ba2b27bf3f964a7f8` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:43.519281 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1034/2074] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:43.522743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd60b829d9004c8ba2b27bf3f964a7f8)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:43.529854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:43.606597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:43.690322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd60b829d9004c8ba2b27bf3f964a7f8', 'request_id': 'req-bf57e726-34d2-43ad-bbdc-04c4d5249276'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:43.704693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd60b829d9004c8ba2b27bf3f964a7f8', 'request_id': 'req-bf57e726-34d2-43ad-bbdc-04c4d5249276'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:43.726550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd60b829d9004c8ba2b27bf3f964a7f8', 'request_id': 'req-bf57e726-34d2-43ad-bbdc-04c4d5249276'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:43.754479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] The token cache is being invalidate because project cd60b829d9004c8ba2b27bf3f964a7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:43.754776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:43.764034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf57e726-34d2-43ad-bbdc-04c4d5249276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:43.769426 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1041/2075] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:43 2022] DELETE /identity/v3/projects/cd60b829d9004c8ba2b27bf3f964a7f8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:43.772854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:43.773373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:43.773712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:43.802932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:43.808468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:43.954392 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1035/2076] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:43.956841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:43.957220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:43.957464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.020396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:44.022256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.054492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.057067 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1042/2077] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:44.073889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117b2c7-21e4-44d0-a86d-f8f493563224 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.104586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.104586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.104586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.104586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.105177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:44.105177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.108988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.139180 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1036/2078] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:48:44.146616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.160179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa3bb-a3fd-4539-8f1b-da8dfd6a0833 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.165607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.166793 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.167938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.168062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.169128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.170071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.171068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.173704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.192886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d26bf5-d187-424d-9487-021c8906af20 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.213978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.214898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.215187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.216638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] PATH_INFO: `/v3/projects/1cd3302fa4ed4b3c80692bc28cb761d2` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.220972 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd3302fa4ed4b3c80692bc28cb761d2)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.222950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.235295 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1043/2079] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:44 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:44.236370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.334339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689192-a4f0-4f2b-89f3-11bdb3619902 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.383134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd3302fa4ed4b3c80692bc28cb761d2', 'request_id': 'req-6de277b6-8fba-4c30-807c-2e312c06686d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.395836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd3302fa4ed4b3c80692bc28cb761d2', 'request_id': 'req-6de277b6-8fba-4c30-807c-2e312c06686d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.418819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd3302fa4ed4b3c80692bc28cb761d2', 'request_id': 'req-6de277b6-8fba-4c30-807c-2e312c06686d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.446781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] The token cache is being invalidate because project 1cd3302fa4ed4b3c80692bc28cb761d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:44.447809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.448126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.448571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.449176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.450240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.450688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.450989 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1037/2080] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:44 2022] DELETE /identity/v3/projects/1cd3302fa4ed4b3c80692bc28cb761d2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:44.451842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.454043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.458288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.460170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.472445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:44.479119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de277b6-8fba-4c30-807c-2e312c06686d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.495177 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1044/2081] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:44 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:44.496194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.497920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.499376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.499874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.500358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.500715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] PATH_INFO: `/v3/users/01780a5c7cb74c56af380aad57245a1b` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.502258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01780a5c7cb74c56af380aad57245a1b)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.504428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.536790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eb475-27e8-435f-9921-2f45f6aa9076 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.545654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.546609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.547047 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.547491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.548407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.552049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.582237 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1045/2082] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:44.583225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.603540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094e84-a2c8-4628-b1d1-a5b099fbe1a8 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.615852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01780a5c7cb74c56af380aad57245a1b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.616844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.617760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.618034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.618564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.619859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.621533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.631288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01780a5c7cb74c56af380aad57245a1b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.632380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01780a5c7cb74c56af380aad57245a1b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.648166 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1046/2083] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:44.649341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.654775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.667057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01780a5c7cb74c56af380aad57245a1b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.675880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:44.680575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de4dd2-ced9-4de5-a398-cbf6ea12696a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.685076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01780a5c7cb74c56af380aad57245a1b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.693823 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1038/2084] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:44 2022] DELETE /identity/v3/users/01780a5c7cb74c56af380aad57245a1b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:44.698587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:44.699709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.700600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.700878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.701708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] PATH_INFO: `/v3/users/1616d0b2af1a41abb4bce4592216fd4a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.702562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1616d0b2af1a41abb4bce4592216fd4a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.704512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.706892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.808428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1616d0b2af1a41abb4bce4592216fd4a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.818461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1616d0b2af1a41abb4bce4592216fd4a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.819299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1616d0b2af1a41abb4bce4592216fd4a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.829301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1616d0b2af1a41abb4bce4592216fd4a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.830468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0d7b5daa-b01a-45a5-a41c-b65f492e4f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1616d0b2af1a41abb4bce4592216fd4a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:44.832155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd002eb8-c6e4-4167-ab0a-0ae3e4a5bcfc admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:44.844048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9660bd4-7127-4d7a-887c-6ed2dcec6b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:44.845689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9660bd4-7127-4d7a-887c-6ed2dcec6b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.846162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9660bd4-7127-4d7a-887c-6ed2dcec6b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.846632 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9660bd4-7127-4d7a-887c-6ed2dcec6b10 admin admin] PATH_INFO: `/v3/projects/04d25055ee7043e685d5def6940251e8/users/b01beafdd2fc4823ab87ecde11e8f33d/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.870601 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1047/2085] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:44 2022] DELETE /identity/v3/users/1616d0b2af1a41abb4bce4592216fd4a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:44.875229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.875534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9660bd4-7127-4d7a-887c-6ed2dcec6b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d25055ee7043e685d5def6940251e8, user_id=b01beafdd2fc4823ab87ecde11e8f33d, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:44.875883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.876337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.878769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9660bd4-7127-4d7a-887c-6ed2dcec6b10 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:44.905646 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1039/2086] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:44 2022] PUT /identity/v3/projects/04d25055ee7043e685d5def6940251e8/users/b01beafdd2fc4823ab87ecde11e8f33d/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:44.914706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:44.916539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:44.917418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:44.917709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:44.917987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:44.956439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] MFA Rules not processed for user `b01beafdd2fc4823ab87ecde11e8f33d`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:44.957800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.015859 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1048/2087] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:45.020006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.022653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.044835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb39f3-7fee-4ae4-a40a-b00839f046c8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.053925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:45.065069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.065999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.066283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.066599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] PATH_INFO: `/v3/projects/c8ca44e9eab5455da60e81112234026f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.067999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ca44e9eab5455da60e81112234026f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.070377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.091450 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1040/2088] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:45.096507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.107902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.151815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0017-2a0c-43e1-8941-cb3a2645754f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.164488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.167264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.167446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.168867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.170049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.177525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.215268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ca44e9eab5455da60e81112234026f', 'request_id': 'req-fd310324-8c52-4bf9-861b-d4645ebaaa14'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.227025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ca44e9eab5455da60e81112234026f', 'request_id': 'req-fd310324-8c52-4bf9-861b-d4645ebaaa14'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.245447 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ca44e9eab5455da60e81112234026f', 'request_id': 'req-fd310324-8c52-4bf9-861b-d4645ebaaa14'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.260801 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1041/2089] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:45 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:45.261553 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.263431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.267170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:45.277306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] The token cache is being invalidate because project c8ca44e9eab5455da60e81112234026f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:45.279310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.280797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.291308 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1049/2090] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:45 2022] DELETE /identity/v3/projects/c8ca44e9eab5455da60e81112234026f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:45.294232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.322530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.487804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595002f7-c9e9-4287-840e-cacdfa3cc3e2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.499854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.500524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.500806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.501082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.506321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.529542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd310324-8c52-4bf9-861b-d4645ebaaa14 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.692571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.692571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.692571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.692571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.693460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.695248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.699778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.701570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.716125 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1042/2091] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:45.717706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.719718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:45.732118 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1050/2092] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:45 2022] POST /identity/v3/users => generated 296 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:45.735394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.740007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b296-7660-4dd5-9afb-811327f2295f service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.751251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.752441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.752877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.753409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] PATH_INFO: `/v3/users/d2014133e2c146f197566789096dfc98` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.753960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab1a80-ed4c-459f-ae45-e612a5670a33 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.754857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2014133e2c146f197566789096dfc98)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.757678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.759280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.760865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.761261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.761583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.762389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.764474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.777773 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1051/2093] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:45.781579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.793994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fa69-f3e3-4bf3-85fa-1bdefe2f3bf1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.799634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:45.802416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:45.802996 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:45.803652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] PATH_INFO: `/v3/projects/41f35beed17a4e6091bb651fd45ef378/users/e0aeb65d87c842869b8b0a75efb57bb3/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:45.824484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f35beed17a4e6091bb651fd45ef378, user_id=e0aeb65d87c842869b8b0a75efb57bb3, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:45.828300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:45.852773 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1052/2094] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:45 2022] PUT /identity/v3/projects/41f35beed17a4e6091bb651fd45ef378/users/e0aeb65d87c842869b8b0a75efb57bb3/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:45.857645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:45.864480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2014133e2c146f197566789096dfc98'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.880475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2014133e2c146f197566789096dfc98'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.881378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2014133e2c146f197566789096dfc98'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.913488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:45.917711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2014133e2c146f197566789096dfc98'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.935067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2014133e2c146f197566789096dfc98'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:45.946104 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1043/2095] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:45 2022] DELETE /identity/v3/users/d2014133e2c146f197566789096dfc98 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:45.965113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5959-1f2b-466f-b57e-662f0aac4df1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:45.971705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:46.032124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:46.033780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:46.099370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:46.100230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.100627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.101005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.109352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:46.111379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:46.129803 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1053/2096] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:46.142444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:46.146280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:46.181917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071e8ae-dc1e-4609-a293-9e30ae660b86 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:46.197069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44328763-f818-4c5b-a9e4-57ae594597f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:46.199334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44328763-f818-4c5b-a9e4-57ae594597f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.199697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44328763-f818-4c5b-a9e4-57ae594597f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.201740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44328763-f818-4c5b-a9e4-57ae594597f7 admin admin] PATH_INFO: `/v3/projects/41f35beed17a4e6091bb651fd45ef378/users/e0aeb65d87c842869b8b0a75efb57bb3/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.206105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44328763-f818-4c5b-a9e4-57ae594597f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f35beed17a4e6091bb651fd45ef378, user_id=e0aeb65d87c842869b8b0a75efb57bb3, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:46.213573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d1ffa-4a2c-4cb1-a68c-2e1b60ce1fd5 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:46.213966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44328763-f818-4c5b-a9e4-57ae594597f7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:46.229772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:46.230969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.232598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.232993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] PATH_INFO: `/v3/projects/09f643a4449349e8bc603614f85768d4` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.235051 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f643a4449349e8bc603614f85768d4)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:46.237537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:46.242519 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1054/2097] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:46 2022] PUT /identity/v3/projects/41f35beed17a4e6091bb651fd45ef378/users/e0aeb65d87c842869b8b0a75efb57bb3/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:46.252223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.253321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.253709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.313603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] MFA Rules not processed for user `e0aeb65d87c842869b8b0a75efb57bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:46.316806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:46.385522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f643a4449349e8bc603614f85768d4', 'request_id': 'req-98c53ee6-a550-41c2-af08-e146db228382'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:46.400365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f643a4449349e8bc603614f85768d4', 'request_id': 'req-98c53ee6-a550-41c2-af08-e146db228382'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:46.419930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f643a4449349e8bc603614f85768d4', 'request_id': 'req-98c53ee6-a550-41c2-af08-e146db228382'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:46.449878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] The token cache is being invalidate because project 09f643a4449349e8bc603614f85768d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:46.453070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:46.454309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-98c53ee6-a550-41c2-af08-e146db228382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:46.464612 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1044/2098] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:46 2022] DELETE /identity/v3/projects/09f643a4449349e8bc603614f85768d4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:46.469220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc06a-7691-499d-a596-d4a3fcad65b1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.469598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc06a-7691-499d-a596-d4a3fcad65b1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.470136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc06a-7691-499d-a596-d4a3fcad65b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.504025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f21dc06a-7691-499d-a596-d4a3fcad65b1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:46.505426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f21dc06a-7691-499d-a596-d4a3fcad65b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:46.533537 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1055/2099] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:46.560290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:46.563068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:46.692220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0582214-6e69-4469-a3b7-be9a980c4ff0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:46.718645 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1045/2100] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:46.721078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79229daf-86b2-49ae-b674-6b775295601c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.721884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79229daf-86b2-49ae-b674-6b775295601c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.722112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79229daf-86b2-49ae-b674-6b775295601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.751824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-79229daf-86b2-49ae-b674-6b775295601c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:46.753631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-79229daf-86b2-49ae-b674-6b775295601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:46.758142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:46.770828 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1046/2101] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:46.774290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79229daf-86b2-49ae-b674-6b775295601c None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:46.783203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:46.783863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.784144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.784422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.790940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79229daf-86b2-49ae-b674-6b775295601c None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:46.796942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:46.797800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.798232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.798621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.799636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:46.800383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:46.801973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:46.814198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:46.819048 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1047/2102] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:46.824488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:46.849014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a5de5-94bc-479a-bdc5-8791f404f3e2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:46.871183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:46.872915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:46.876682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:46.879761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:46.881027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:46.881493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:46.882796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:46.887654 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1056/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:46.889545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:46.931866 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1048/2104] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:46 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:46.936829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:46.960257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176cbc0-6301-4bcd-89e2-32e67cf7731c service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.001662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.068366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.070352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.070785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.071255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.072439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.075441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.104899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8605-c3f9-4178-a743-b9e36df72827 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.114953 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1057/2105] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:46 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:47.118831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.119759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.120457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.121029 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.128473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.134193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.138232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67d47-3865-4195-b94f-fe3feddfad18 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.149920 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.152803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.153312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.153733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.154496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.156203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.174048 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1058/2106] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:47.175595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.178464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.195565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb8e59-c7b0-4fda-9b16-18d77ebf1d52 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.204478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.205390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.205676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.205970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] PATH_INFO: `/v3/projects/1ff42009f09a4336b459ca2af2d26656` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.207220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff42009f09a4336b459ca2af2d26656)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.209236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.243614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.245338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.254968 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1049/2107] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:47.255768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.257357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.263368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff42009f09a4336b459ca2af2d26656', 'request_id': 'req-cddfcd06-bd71-47d1-bde4-670c67883aa8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.269429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:47.270827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff42009f09a4336b459ca2af2d26656', 'request_id': 'req-cddfcd06-bd71-47d1-bde4-670c67883aa8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.272448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc0531-93ea-401c-af7e-fbeb1d23a6e6 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.287448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff42009f09a4336b459ca2af2d26656', 'request_id': 'req-cddfcd06-bd71-47d1-bde4-670c67883aa8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.302856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] The token cache is being invalidate because project 1ff42009f09a4336b459ca2af2d26656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:47.303238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.303966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.305853 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1059/2108] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:47 2022] DELETE /identity/v3/projects/1ff42009f09a4336b459ca2af2d26656 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:47.309792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.311248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.349834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.351461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.351828 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.352185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] PATH_INFO: `/v3/projects/ac0f1e0a0dd54b58a58ab800f8da1167` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.354323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0f1e0a0dd54b58a58ab800f8da1167)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.356938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.404081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfcd06-bd71-47d1-bde4-670c67883aa8 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.409900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646f6e-7006-4f93-86de-283b0812d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.410711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646f6e-7006-4f93-86de-283b0812d739 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.411049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646f6e-7006-4f93-86de-283b0812d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.411276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646f6e-7006-4f93-86de-283b0812d739 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.412014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646f6e-7006-4f93-86de-283b0812d739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.414049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646f6e-7006-4f93-86de-283b0812d739 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.429639 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1060/2109] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:47.429978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:47.431736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d1c57-8cbc-4993-9020-a153defbb1ec None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.432033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d1c57-8cbc-4993-9020-a153defbb1ec None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.432342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d1c57-8cbc-4993-9020-a153defbb1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.453578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0f1e0a0dd54b58a58ab800f8da1167', 'request_id': 'req-748666b4-93eb-44bb-8139-4dd1f0698a3b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.454765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-804d1c57-8cbc-4993-9020-a153defbb1ec None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:47.455756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-804d1c57-8cbc-4993-9020-a153defbb1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.468935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0f1e0a0dd54b58a58ab800f8da1167', 'request_id': 'req-748666b4-93eb-44bb-8139-4dd1f0698a3b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.478069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0f1e0a0dd54b58a58ab800f8da1167', 'request_id': 'req-748666b4-93eb-44bb-8139-4dd1f0698a3b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.497798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] The token cache is being invalidate because project ac0f1e0a0dd54b58a58ab800f8da1167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:47.498333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.501288 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.503131 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1050/2110] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:47 2022] DELETE /identity/v3/projects/ac0f1e0a0dd54b58a58ab800f8da1167 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:47.503941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.511795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.542618 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1061/2111] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:47.543968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39008603-e399-4049-83c0-c782216aa6c7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.544257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39008603-e399-4049-83c0-c782216aa6c7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.544673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39008603-e399-4049-83c0-c782216aa6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.568470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-39008603-e399-4049-83c0-c782216aa6c7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:47.569880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-39008603-e399-4049-83c0-c782216aa6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.586735 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1062/2112] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:47.590795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8bc23-ab40-41f8-bd96-4b04dd717bd6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.591267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8bc23-ab40-41f8-bd96-4b04dd717bd6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.591965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8bc23-ab40-41f8-bd96-4b04dd717bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.616806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f7d8bc23-ab40-41f8-bd96-4b04dd717bd6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:47.618341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f7d8bc23-ab40-41f8-bd96-4b04dd717bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.632867 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1063/2113] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:47.634578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.635539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.635818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.650849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748666b4-93eb-44bb-8139-4dd1f0698a3b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.655272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:47.656133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.656611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.657227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.657590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.657949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] PATH_INFO: `/v3/projects/f603991bae6143c9b7b6b9ca2d63ed42/users/1e477e109da74e86878de04bd82d2f11/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.665273 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1064/2114] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:47.666164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.667446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.679175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f603991bae6143c9b7b6b9ca2d63ed42, user_id=1e477e109da74e86878de04bd82d2f11, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.680160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991d25-7d28-4209-9f86-bfb58963f9ef None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.682779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.686993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.687881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.688164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.688440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] PATH_INFO: `/v3/users/b01beafdd2fc4823ab87ecde11e8f33d` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.690266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01beafdd2fc4823ab87ecde11e8f33d)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.692221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.703058 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1051/2115] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:47 2022] PUT /identity/v3/projects/f603991bae6143c9b7b6b9ca2d63ed42/users/1e477e109da74e86878de04bd82d2f11/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:47.704146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.756290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01beafdd2fc4823ab87ecde11e8f33d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.764075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01beafdd2fc4823ab87ecde11e8f33d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.764826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01beafdd2fc4823ab87ecde11e8f33d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.766880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:47.774602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01beafdd2fc4823ab87ecde11e8f33d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.775814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01beafdd2fc4823ab87ecde11e8f33d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:47.777084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7e575-082c-481e-a387-431512e778e1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.782056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.782717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.783003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.783286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.784171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:47.784485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.786140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf4460-162c-4a3e-981d-edc189121a47 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.797570 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1065/2116] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:47 2022] DELETE /identity/v3/users/b01beafdd2fc4823ab87ecde11e8f33d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:47.798855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.800835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.802149 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1052/2117] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:47.803274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.803564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.804098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.832933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] MFA Rules not processed for user `1e477e109da74e86878de04bd82d2f11`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:47.834336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.866547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:47.871624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b335-f772-47a6-a8e5-ca9ed6a90950 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.876420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.877080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.877412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.877691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.878414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:47.878718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.880442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e70861-a8f4-476b-8a01-9cec14ca7a02 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.893190 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1066/2118] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:47.894379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.894667 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.894946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.909674 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1053/2119] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:47.910567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.911830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.913332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:47.914537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.922394 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1067/2120] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:47.923154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.925556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcf480-5e78-4192-aec0-d2a2ad40d0bc None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.931116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.932771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.933058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.933372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.934009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfebfaf-2644-4baf-bb4b-1867df55589c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:47.934113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.935959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.938955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:47.939755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:47.940041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:47.940319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:47.941008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:47.943064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:47.963861 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1054/2121] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:47.964810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.967290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:47.971860 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1068/2122] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:47.972582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:47.974187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:48.039723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac4f9-2a50-44c5-b506-f6d2e4d68bf6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.046452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3703d2-4306-4d62-976a-6bc686eb8c09 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.051215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.052129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.052601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.053042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.117679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.118341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.118630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.119597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.120296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.121966 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:48.122312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.136413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.137887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.148569 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1069/2123] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:48.149465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.150714 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1055/2124] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:47 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:48.151523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.159208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c391b-2928-4e93-a6ca-d05217b1ee9b service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.208174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:48.236701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b6135-dcd7-4688-8e17-073923146f4c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.238305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.239093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.239794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.240092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.240836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.242947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.243354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.244623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.245027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.245498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.246275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.248182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.265776 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1070/2125] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:48.266612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.270289 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1056/2126] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:48.271373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.277312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae309ef3-de0c-486e-8dc0-39a4700267f5 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.282328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.283011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.283295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.283587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.284264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.284422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953911-eb43-41d7-90ac-3e75e03edc15 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.286267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.289694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.290448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.291314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.291709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.292527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.294665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.308041 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1057/2127] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:48.308969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.312561 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1071/2128] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:48.314287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.321385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfcf32-fb45-4065-9605-94901c3d47ce admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.327150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143414d1-9456-449c-a439-e9275fdc030f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.329261 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.330344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.330926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.331340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.332602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.333755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.334580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.334875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.335205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.335950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.338277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.339100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.352152 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1058/2129] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:48.353363 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1072/2130] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:48.353865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.356822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.366556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466cd48-033a-4e98-9ee1-1487936b13e2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.367476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6fb04-7947-4a55-83f7-56fd0be8c392 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.373438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.373631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.374157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.374440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.374600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.374702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.375049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.375439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.375536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.376495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.377066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.378351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.389076 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1059/2131] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:48.389806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.395715 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1073/2132] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:48.396697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.406806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883cf43-97bf-4d62-815b-f2a27cb1ae52 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.407413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcca5f-a2de-4909-ab45-275072655183 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.411630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.412416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.412826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.413204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.413557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] PATH_INFO: `/v3/projects/2928fe61b3c44d84bfcaa690ba07b958/users/5d9b13c297f74bc8ad353bf77ca33477/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.413731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.414081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.414426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] PATH_INFO: `/v3/projects/57b53f70397740e8826f508702f630f4/users/2d53cd59f51a4723b21e66027807d73c/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.432064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b53f70397740e8826f508702f630f4, user_id=2d53cd59f51a4723b21e66027807d73c, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.432436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2928fe61b3c44d84bfcaa690ba07b958, user_id=5d9b13c297f74bc8ad353bf77ca33477, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.434716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.434832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.452872 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1074/2134] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:48 2022] PUT /identity/v3/projects/57b53f70397740e8826f508702f630f4/users/2d53cd59f51a4723b21e66027807d73c/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:48.454032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.455853 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1060/2134] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:48 2022] PUT /identity/v3/projects/2928fe61b3c44d84bfcaa690ba07b958/users/5d9b13c297f74bc8ad353bf77ca33477/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:48.456822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.524768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6340-29ae-42d3-ba2e-219847bfaad1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.528294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882cbd-f98a-45fa-a596-9f45704a2957 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.530417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bfcc6-aae6-492d-aa57-4163539d8724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.531199 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfcc6-aae6-492d-aa57-4163539d8724 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.531586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfcc6-aae6-492d-aa57-4163539d8724 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.531988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfcc6-aae6-492d-aa57-4163539d8724 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.532826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bfcc6-aae6-492d-aa57-4163539d8724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.533226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.534402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.534536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.534796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] PATH_INFO: `/v3/projects/8d0a5cdbf42940ce979f90928213cb12/users/d3ec6d2726de482d8fe1de0689efe4e1/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.535270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bfcc6-aae6-492d-aa57-4163539d8724 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.549320 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1061/2135] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:48.551125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac7ec-1184-4f67-991d-5b7538b9c4ec None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.551578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac7ec-1184-4f67-991d-5b7538b9c4ec None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.551856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac7ec-1184-4f67-991d-5b7538b9c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.554353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0a5cdbf42940ce979f90928213cb12, user_id=d3ec6d2726de482d8fe1de0689efe4e1, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.558312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.569888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:48.579454 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1075/2136] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:48 2022] PUT /identity/v3/projects/8d0a5cdbf42940ce979f90928213cb12/users/d3ec6d2726de482d8fe1de0689efe4e1/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:48.581153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.589547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d88ac7ec-1184-4f67-991d-5b7538b9c4ec None None] MFA Rules not processed for user `5d9b13c297f74bc8ad353bf77ca33477`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:48.590839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d88ac7ec-1184-4f67-991d-5b7538b9c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:48.655970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:48.662719 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1062/2137] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:48.664382 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.665073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.666417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.666743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c4e9-d3ac-4d7d-920d-336d51439549 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.675256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.676255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.676537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.676809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] PATH_INFO: `/v3/projects/57b53f70397740e8826f508702f630f4/users/2d53cd59f51a4723b21e66027807d73c/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.679111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b53f70397740e8826f508702f630f4, user_id=2d53cd59f51a4723b21e66027807d73c, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.683584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.706702 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1076/2138] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:48 2022] PUT /identity/v3/projects/57b53f70397740e8826f508702f630f4/users/2d53cd59f51a4723b21e66027807d73c/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:48.706702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.714621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] MFA Rules not processed for user `d3ec6d2726de482d8fe1de0689efe4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:48.715918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:48.797608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd6b53-e9af-4b79-93b9-2bb261dfe352 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.804690 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1063/2139] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:48.804690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.804690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:48.805301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d84dfa-7380-43b8-b75f-8cb05e65e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.805811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d84dfa-7380-43b8-b75f-8cb05e65e0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.806081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d84dfa-7380-43b8-b75f-8cb05e65e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.806463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d84dfa-7380-43b8-b75f-8cb05e65e0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.807366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d84dfa-7380-43b8-b75f-8cb05e65e0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.809324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d84dfa-7380-43b8-b75f-8cb05e65e0f1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.830446 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5c2b5-9fb4-4c0e-a8ca-66af740888c1 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:48.843654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:48.847111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.847111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.847111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] PATH_INFO: `/v3/projects/04d25055ee7043e685d5def6940251e8` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.847441 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1077/2140] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:48.848454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d25055ee7043e685d5def6940251e8)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:48.849190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:48.849694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:48.850141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:48.858817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:48.894894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] MFA Rules not processed for user `2d53cd59f51a4723b21e66027807d73c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:48.896729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:48.919959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d25055ee7043e685d5def6940251e8', 'request_id': 'req-e40a0a34-9aa5-4f76-847a-02ff55c29109'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:48.926738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d25055ee7043e685d5def6940251e8', 'request_id': 'req-e40a0a34-9aa5-4f76-847a-02ff55c29109'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:48.932700 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d25055ee7043e685d5def6940251e8', 'request_id': 'req-e40a0a34-9aa5-4f76-847a-02ff55c29109'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:48.947375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] The token cache is being invalidate because project 04d25055ee7043e685d5def6940251e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:48.948293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:48.949062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:48.951604 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1064/2141] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:48 2022] DELETE /identity/v3/projects/04d25055ee7043e685d5def6940251e8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:48.952841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.956554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:48.990827 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1078/2142] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:48.991962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:48.995167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:49.003072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:49.064611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0a34-9aa5-4f76-847a-02ff55c29109 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.074117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.074807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.075098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.075373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.076084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.078254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.090369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb8ef2-589d-4182-ad4f-2663ace42624 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.093977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:49.097262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.098038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.098409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.098749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.099582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.102439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.119533 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1065/2143] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:49.120809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.127941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:49.136824 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1079/2144] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:48 2022] POST /identity/v3/users => generated 306 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:49.138331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.141049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:49.215301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630ae3-c483-4179-b7b7-8dbf2fb881dc admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.220602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.221528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.221807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.222082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] PATH_INFO: `/v3/users/e0aeb65d87c842869b8b0a75efb57bb3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.223471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0aeb65d87c842869b8b0a75efb57bb3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.223590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355feb6-f977-4995-8426-27ead588162a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.225486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.292085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.293078 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.293482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.293924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.303559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0aeb65d87c842869b8b0a75efb57bb3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:49.318188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0aeb65d87c842869b8b0a75efb57bb3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:49.319591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0aeb65d87c842869b8b0a75efb57bb3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:49.346541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0aeb65d87c842869b8b0a75efb57bb3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:49.359502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0aeb65d87c842869b8b0a75efb57bb3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:49.369715 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1066/2145] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:49 2022] DELETE /identity/v3/users/e0aeb65d87c842869b8b0a75efb57bb3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:49.370537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.371934 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:49.378107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.380148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.386182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:49.399134 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1080/2146] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:49.400675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.414386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9227ee-950c-47fb-8166-76820b057ad0 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.507648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d3b6-e297-4294-995d-0aebb9fd2aca admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.513928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.514843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.515404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.516083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.516932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.519044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.519304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.520025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.520450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.521241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.526810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.529735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.556075 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1067/2147] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:49 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:49.560273 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1081/2148] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:49.560910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.567785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.570049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:49.570404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:49.576293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09970-9503-4d3f-92ab-10b30b2a7480 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.583829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.585290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.588389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.588389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.588801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.590690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.594664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad48a1-a1ed-4616-b319-e38b07274ce7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.602015 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.603146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.603436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.603714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] PATH_INFO: `/v3/projects/19140632702c48bebe39f7ef690aaf42/users/8079716ca8284a268887db3bcae39513/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.613036 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1068/2149] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:49.619332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.625747 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19140632702c48bebe39f7ef690aaf42, user_id=8079716ca8284a268887db3bcae39513, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.628450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.643441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164babf-13e4-4665-ab7a-60808e5e530b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.657188 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1082/2150] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:49 2022] PUT /identity/v3/projects/19140632702c48bebe39f7ef690aaf42/users/8079716ca8284a268887db3bcae39513/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:49.661368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.758179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.759200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.759762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.760315 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.761690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.764597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.765928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7674d6-43d7-4d6d-83a6-a3619d56f06e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.771131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.771841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.772302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.772496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.773416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.775282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.776858 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1069/2151] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:49.781105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.794593 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1083/2152] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:49.795569 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:49.806980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e2fe-b277-4a48-beb6-86fda084b1ab admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.808379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce731f0-029e-44ca-acfd-589c8d96b577 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:49.813858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18060d9a-cc04-4d04-ad25-ecfade3b55f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.814008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796136fd-e441-474d-8e03-48ed7ae209ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:49.815255 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060d9a-cc04-4d04-ad25-ecfade3b55f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.815465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796136fd-e441-474d-8e03-48ed7ae209ef admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.815765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796136fd-e441-474d-8e03-48ed7ae209ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.816044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796136fd-e441-474d-8e03-48ed7ae209ef admin admin] PATH_INFO: `/v3/projects/19140632702c48bebe39f7ef690aaf42/users/8079716ca8284a268887db3bcae39513/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.816432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060d9a-cc04-4d04-ad25-ecfade3b55f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.817028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060d9a-cc04-4d04-ad25-ecfade3b55f8 admin admin] PATH_INFO: `/v3/projects/8a4142e97152447387058f906d1f474d/users/674c34ceabdb4170adaa9873c733d328/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.818127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796136fd-e441-474d-8e03-48ed7ae209ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=19140632702c48bebe39f7ef690aaf42, user_id=8079716ca8284a268887db3bcae39513, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.823878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796136fd-e441-474d-8e03-48ed7ae209ef admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.835720 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1084/2153] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:49 2022] PUT /identity/v3/projects/19140632702c48bebe39f7ef690aaf42/users/8079716ca8284a268887db3bcae39513/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:49.847114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.848161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.848453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.870406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18060d9a-cc04-4d04-ad25-ecfade3b55f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4142e97152447387058f906d1f474d, user_id=674c34ceabdb4170adaa9873c733d328, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:49.874401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18060d9a-cc04-4d04-ad25-ecfade3b55f8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:49.899451 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1070/2154] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:49 2022] PUT /identity/v3/projects/8a4142e97152447387058f906d1f474d/users/674c34ceabdb4170adaa9873c733d328/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:49.900907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] MFA Rules not processed for user `8079716ca8284a268887db3bcae39513`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:49.904917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:49.912846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:49.913213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:49.913949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:49.988162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] MFA Rules not processed for user `674c34ceabdb4170adaa9873c733d328`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:49.989437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.024469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:50.094722 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1085/2155] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:50.097461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.102320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.134256 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1071/2156] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:50.136075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.137614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.210604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6fbc-b00e-4cce-afc5-2232250a1d2f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.216701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.217639 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.226699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.226699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.234445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc8979-061d-4741-97cc-1a5506e9bc43 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.240278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.241189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.241474 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.241753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] PATH_INFO: `/v3/users/1e477e109da74e86878de04bd82d2f11` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.242967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.244224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e477e109da74e86878de04bd82d2f11)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.246180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.246305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.251832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:50.276855 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1072/2157] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:50.278630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.282550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.311329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def9dd0-ae90-4d55-a17a-d3c23f894daf service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.320339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.321310 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.321573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.322313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] PATH_INFO: `/v3/projects/41f35beed17a4e6091bb651fd45ef378` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.323519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e477e109da74e86878de04bd82d2f11'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.323868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f35beed17a4e6091bb651fd45ef378)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.325815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.331827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e477e109da74e86878de04bd82d2f11'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.332600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e477e109da74e86878de04bd82d2f11'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.345000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e477e109da74e86878de04bd82d2f11'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.348429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e477e109da74e86878de04bd82d2f11'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.384906 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1086/2158] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:50 2022] DELETE /identity/v3/users/1e477e109da74e86878de04bd82d2f11 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:50.384906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.385597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.407130 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f35beed17a4e6091bb651fd45ef378', 'request_id': 'req-5a714021-c73f-45a6-8145-ee985d974bb6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.413322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f35beed17a4e6091bb651fd45ef378', 'request_id': 'req-5a714021-c73f-45a6-8145-ee985d974bb6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.420379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f35beed17a4e6091bb651fd45ef378', 'request_id': 'req-5a714021-c73f-45a6-8145-ee985d974bb6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.434900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] The token cache is being invalidate because project 41f35beed17a4e6091bb651fd45ef378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:50.435193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.435837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5a714021-c73f-45a6-8145-ee985d974bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:50.437451 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1073/2159] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:50 2022] DELETE /identity/v3/projects/41f35beed17a4e6091bb651fd45ef378 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:50.438680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.439125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.439390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.450151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:50.454516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87461d2-9b98-417e-a227-bf2e597036b3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.463141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:50.464390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.529031 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1074/2160] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:50.529253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5d423-8adf-4dda-83e1-70169cf59658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.529467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.529663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5d423-8adf-4dda-83e1-70169cf59658 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.529663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5d423-8adf-4dda-83e1-70169cf59658 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.529663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5d423-8adf-4dda-83e1-70169cf59658 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.529879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.529971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5d423-8adf-4dda-83e1-70169cf59658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.530929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5d423-8adf-4dda-83e1-70169cf59658 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.561249 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1087/2161] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:50.562621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.562910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.563401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.582649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:50.583824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.591096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7c4ef-97cd-46d2-92f3-077e3d59d023 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.625781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:50.642598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.643252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.643539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.643824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.645636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.646554 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1088/2162] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:50.653401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.653401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.709497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.710298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18449005-d2a4-4939-a379-69389ccf9419 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.710951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.714220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb688-6ea5-49b1-8aec-f70d41ff7523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.714857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb688-6ea5-49b1-8aec-f70d41ff7523 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.715134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb688-6ea5-49b1-8aec-f70d41ff7523 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.715412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb688-6ea5-49b1-8aec-f70d41ff7523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.720533 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1075/2163] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:50.721331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.722585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.725186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fb688-6ea5-49b1-8aec-f70d41ff7523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.726724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fb688-6ea5-49b1-8aec-f70d41ff7523 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.737216 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1089/2164] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:50.737498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df678d1-6231-49b7-8f37-d2457fcf6b8c service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.738880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.739131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.739383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.742575 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.743484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.744383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.744878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.746137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.748846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.758733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:50.761201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:50.770878 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1090/2165] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:50.776111 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1076/2166] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/users => generated 299 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:50.776275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.777275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.785660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932ff9-ec2e-43eb-a6c6-827350d32494 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.789480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2604f96-6f2b-4d97-82d2-a149b7163f91 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.792020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.793233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.793518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.793816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.794583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:50.794942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.796216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.796561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.797275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.797681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.798697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.799482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.801825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.816601 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1091/2167] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:48:50.821579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.831878 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1077/2168] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:50.836401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.853855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9841b-c7f3-4521-a2f3-148c5dc91d3e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.861349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8103e1-3d25-4338-af04-b9fd38d1874a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:50.862741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.864868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.865186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.865698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.866619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.870002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.872697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:50.874187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:50.874685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:50.875538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] PATH_INFO: `/v3/projects/e4536501cf25452c9abd00ad352c2342/users/199dc4fe695640eebf0495f1352ab548/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:50.885310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:50.902680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4536501cf25452c9abd00ad352c2342, user_id=199dc4fe695640eebf0495f1352ab548, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:50.907187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:50.919363 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1092/2169] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:50.923865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:50.941873 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1078/2170] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:50 2022] PUT /identity/v3/projects/e4536501cf25452c9abd00ad352c2342/users/199dc4fe695640eebf0495f1352ab548/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:50.945868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.048456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3c43e-81ab-45de-aab4-471a5ec9007a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.055174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215e0c3-16d5-46c5-9315-55959677cbc3 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.061126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.061855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.062126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.062408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.063680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.065414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.065674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.066232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.066628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.068050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.069282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.071556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.093054 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1079/2171] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:51.097054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.104855 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1093/2172] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:50 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:51.106776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.117180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee36bb-0fa1-4485-bb84-08335abe6ac6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.119715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3503-5a2c-42ac-9ec0-76de8831ae7a admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.126324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.127957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.128253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.128537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.129567 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.131692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.135849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c18b4-16a9-4c56-9d6c-72d511a329a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.138086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c18b4-16a9-4c56-9d6c-72d511a329a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.139701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c18b4-16a9-4c56-9d6c-72d511a329a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.140169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c18b4-16a9-4c56-9d6c-72d511a329a9 admin admin] PATH_INFO: `/v3/projects/e4536501cf25452c9abd00ad352c2342/users/199dc4fe695640eebf0495f1352ab548/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.144143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c18b4-16a9-4c56-9d6c-72d511a329a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4536501cf25452c9abd00ad352c2342, user_id=199dc4fe695640eebf0495f1352ab548, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.147888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c18b4-16a9-4c56-9d6c-72d511a329a9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.148832 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1094/2173] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:51.154649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.170366 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1080/2174] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:51 2022] PUT /identity/v3/projects/e4536501cf25452c9abd00ad352c2342/users/199dc4fe695640eebf0495f1352ab548/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:51.183357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.183818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.184218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.193835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53004-222d-4ac1-9ad3-61af12d89700 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.271153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] MFA Rules not processed for user `199dc4fe695640eebf0495f1352ab548`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:51.292827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:51.312040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.362891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.366102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.366595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.368143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.372505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.376967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.402034 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1095/2175] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:51.403378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.407098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:51.445088 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1081/2176] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:51.446507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.461551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14307-4b4d-4cab-b059-09c7c6774467 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.474254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.477120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.477601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687b04-c6c0-461d-a48c-96be4d039f5e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.477821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.479190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] PATH_INFO: `/v3/projects/f603991bae6143c9b7b6b9ca2d63ed42` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.481808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f603991bae6143c9b7b6b9ca2d63ed42)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.484619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.485854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.486142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.486423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] PATH_INFO: `/v3/projects/cbfd0d4dd49c464bab39efeb0a87991d/users/f1877c8dc1af45d3b4015950f8e51718/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.487023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.509047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfd0d4dd49c464bab39efeb0a87991d, user_id=f1877c8dc1af45d3b4015950f8e51718, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.513853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.539336 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1082/2177] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:51 2022] PUT /identity/v3/projects/cbfd0d4dd49c464bab39efeb0a87991d/users/f1877c8dc1af45d3b4015950f8e51718/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:51.542623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.598479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f603991bae6143c9b7b6b9ca2d63ed42', 'request_id': 'req-12db9f5e-712c-4d65-a606-def0fc76dfe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.617554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f603991bae6143c9b7b6b9ca2d63ed42', 'request_id': 'req-12db9f5e-712c-4d65-a606-def0fc76dfe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.620654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.635417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f603991bae6143c9b7b6b9ca2d63ed42', 'request_id': 'req-12db9f5e-712c-4d65-a606-def0fc76dfe8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.656823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] The token cache is being invalidate because project f603991bae6143c9b7b6b9ca2d63ed42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:51.657913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.658758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-12db9f5e-712c-4d65-a606-def0fc76dfe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.661568 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1096/2178] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:51 2022] DELETE /identity/v3/projects/f603991bae6143c9b7b6b9ca2d63ed42 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:51.663669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.663928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.664500 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.676670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b627d00-7d13-4e0d-b9b2-4b49205846c3 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.693372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:51.694859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:51.777389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.778128 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1097/2179] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:51.778251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.778512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.778829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.778942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.780165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:51.792620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:51.794761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cee55-4cd5-4f4a-866a-48d0737e2b65 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:51.801536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:51.802467 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:51.802752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:51.803084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] PATH_INFO: `/v3/users/2d53cd59f51a4723b21e66027807d73c` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:51.804307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d53cd59f51a4723b21e66027807d73c)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.806616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.883950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.888162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:51.890522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:51.906733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d53cd59f51a4723b21e66027807d73c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.910633 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1083/2180] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:51.911991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:51.913948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:51.927629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d53cd59f51a4723b21e66027807d73c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.929757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d53cd59f51a4723b21e66027807d73c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.952168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d53cd59f51a4723b21e66027807d73c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.952879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d53cd59f51a4723b21e66027807d73c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:51.989343 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1098/2181] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:51 2022] DELETE /identity/v3/users/2d53cd59f51a4723b21e66027807d73c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:52.039193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d978ce-6dc0-4cda-9aa8-f2e4e1fce2d4 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:52.110809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:52.111492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:52.111774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:52.112086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:52.114246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:52.211629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:52.213908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d7d3-7b22-400b-b8a6-51a1e8ff404e service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:52.228860 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1084/2182] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:52.372455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:52.376550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:52.410907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb11fc5-7e34-4dc2-a67d-d9c652d9905b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:52.423445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:52.426027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:52.426027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:52.426545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] PATH_INFO: `/v3/projects/57b53f70397740e8826f508702f630f4` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:52.430918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b53f70397740e8826f508702f630f4)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:52.436594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:52.522799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b53f70397740e8826f508702f630f4', 'request_id': 'req-f5f90674-1962-4574-a3c6-efc467e548fe'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:52.530690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:52.532183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b53f70397740e8826f508702f630f4', 'request_id': 'req-f5f90674-1962-4574-a3c6-efc467e548fe'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:52.539772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b53f70397740e8826f508702f630f4', 'request_id': 'req-f5f90674-1962-4574-a3c6-efc467e548fe'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:52.560649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] The token cache is being invalidate because project 57b53f70397740e8826f508702f630f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:52.561102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:52.562168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f5f90674-1962-4574-a3c6-efc467e548fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:52.565223 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1099/2183] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:52 2022] DELETE /identity/v3/projects/57b53f70397740e8826f508702f630f4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:52.572631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:52.572865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:52.573027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:52.596017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:52.597665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:52.717017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:52.748577 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1085/2184] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:52.753228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:52.753571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:52.753856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:52.791234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:52.793371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:52.804834 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1100/2185] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:52.810504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:52.828232 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde158d-f9a8-4c37-be9c-a1e218fca01d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:52.833674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:52.834353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:52.834642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:52.834931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:52.835904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:52.836274 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:52.838958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:52.869514 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1086/2186] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:52.874483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:52.886943 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a524a-ab5e-48f4-b876-e2e3b35edf24 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:52.893729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:52.894892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:52.895179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:52.896216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:52.896940 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:52.900810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:52.931464 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1101/2187] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:52 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:52.935606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:52.946006 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c498c-8aa2-4e8c-b330-da99970f0997 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.027918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.028871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.029256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.029610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.030452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.032439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.060601 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1087/2188] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:52 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:53.062045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.075986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0c84-c664-487a-969a-845247eb4b3f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.080379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3108d-d7d3-4edd-84f5-d69624cb717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.081053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3108d-d7d3-4edd-84f5-d69624cb717d admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.081374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3108d-d7d3-4edd-84f5-d69624cb717d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.081653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3108d-d7d3-4edd-84f5-d69624cb717d admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.082388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3108d-d7d3-4edd-84f5-d69624cb717d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.084149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3108d-d7d3-4edd-84f5-d69624cb717d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.100495 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1102/2189] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:53.105686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.118985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434298c-ebb9-4b7f-862a-dea2e7257b46 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.128293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.129785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.130171 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.130577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.137423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.137423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.161204 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1088/2190] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:53.161355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.161355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.161355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.163582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.175664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19251c-e09e-49a7-bb5a-4e621cb9b1a7 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.180512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233e23d-bc21-4392-913c-1cc11c2e482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.181572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233e23d-bc21-4392-913c-1cc11c2e482d admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.182226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233e23d-bc21-4392-913c-1cc11c2e482d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.183197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233e23d-bc21-4392-913c-1cc11c2e482d admin admin] PATH_INFO: `/v3/projects/85ed3d1de2774e02baeae4381780399f/users/d305cf592cfe43e5be73796c2a61ca51/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.199672 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] MFA Rules not processed for user `f1877c8dc1af45d3b4015950f8e51718`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:53.200875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:53.220670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233e23d-bc21-4392-913c-1cc11c2e482d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ed3d1de2774e02baeae4381780399f, user_id=d305cf592cfe43e5be73796c2a61ca51, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.224457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233e23d-bc21-4392-913c-1cc11c2e482d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.249983 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1089/2191] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:53 2022] PUT /identity/v3/projects/85ed3d1de2774e02baeae4381780399f/users/d305cf592cfe43e5be73796c2a61ca51/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:53.260854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.261574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.261874 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.304365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] MFA Rules not processed for user `d305cf592cfe43e5be73796c2a61ca51`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:53.305665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:53.309796 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1103/2192] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:53.311179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.313444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:53.352518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376d05-04fb-4cb1-ac6b-2c2ea6fa6801 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.427465 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1090/2193] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:53.433550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.438161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:53.444913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.445825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.446486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.447717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.448451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.451122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.479936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:53.483298 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1104/2194] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:53 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:53.487032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.514826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1118-a7e8-42a2-8caa-129d5cac9291 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.515077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:53.573846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bb15d-f657-4578-b8be-3d4d8265fc6d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.578709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.580074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.580571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.581033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.581907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.584671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.598112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.598893 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.599327 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.599888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.617662 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1105/2195] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:53 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:53.621445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.633572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246491-6cc7-48c3-ae0c-bb32acaad223 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.640702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.641462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.641743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.642022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.642748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.644519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.659963 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1106/2196] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:53.661298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.675062 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c18af-1758-4250-af31-6080fc0070fb admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.680441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.681805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.682348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.682916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] PATH_INFO: `/v3/projects/c01b8bca094548ad8d08e57fea84b6d0/users/6c2a9d4c88b14adf9cdb7d5d83cf58ca/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.687247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.689649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.701787 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01b8bca094548ad8d08e57fea84b6d0, user_id=6c2a9d4c88b14adf9cdb7d5d83cf58ca, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.713488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.713662 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1091/2197] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:53.734078 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1107/2198] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:53 2022] PUT /identity/v3/projects/c01b8bca094548ad8d08e57fea84b6d0/users/6c2a9d4c88b14adf9cdb7d5d83cf58ca/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:53.735182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.748666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc2ed1-9d89-4b25-882b-d72103d00a05 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.830994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.831741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.832101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.832728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.833688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.835674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.854037 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1092/2199] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:53.855707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.867855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5304-e2d8-457e-bb0f-4b836e2c2a67 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:53.883038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baf538-2afb-4520-861e-68a6f2a0a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:53.883935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf538-2afb-4520-861e-68a6f2a0a549 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:53.884305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf538-2afb-4520-861e-68a6f2a0a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:53.884826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baf538-2afb-4520-861e-68a6f2a0a549 admin admin] PATH_INFO: `/v3/projects/c01b8bca094548ad8d08e57fea84b6d0/users/6c2a9d4c88b14adf9cdb7d5d83cf58ca/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:53.887794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baf538-2afb-4520-861e-68a6f2a0a549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01b8bca094548ad8d08e57fea84b6d0, user_id=6c2a9d4c88b14adf9cdb7d5d83cf58ca, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:53.889585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baf538-2afb-4520-861e-68a6f2a0a549 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:53.915466 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1108/2200] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:53 2022] PUT /identity/v3/projects/c01b8bca094548ad8d08e57fea84b6d0/users/6c2a9d4c88b14adf9cdb7d5d83cf58ca/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:53.974486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:53.977279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:54.078240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:54.107559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c92ff8-da79-4d0f-b74e-35fe0a54f073 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:54.232623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:54.233322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:54.233608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:54.233886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:54.242322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:54.389210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:54.392533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0481e-db96-421c-99de-725e5be94806 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:54.407795 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1093/2201] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:54.864806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:54.865373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:54.865373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:54.900363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] MFA Rules not processed for user `6c2a9d4c88b14adf9cdb7d5d83cf58ca`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:54.902009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:55.001562 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1109/2202] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:55.015548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:55.016318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:55.016585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:55.043616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] MFA Rules not processed for user `f1877c8dc1af45d3b4015950f8e51718`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:55.044865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:55.091277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:55.101487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f5e8e-046f-4486-9576-35c054f15831 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:55.106084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:55.106754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:55.107045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:55.107332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:55.109461 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:55.120284 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1094/2203] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:55.133643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:55.135853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:55.166414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:55.188143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:55.189740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:55.192552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:55.200374 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1110/2204] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:55.216181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47bf3f-1e8c-49bf-a7df-e36f8fa4b507 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:55.222025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcd84c-de8d-4534-9047-2811096e34b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:55.222678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd84c-de8d-4534-9047-2811096e34b8 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:55.222970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd84c-de8d-4534-9047-2811096e34b8 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:55.223248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd84c-de8d-4534-9047-2811096e34b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:55.232090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcd84c-de8d-4534-9047-2811096e34b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:55.233939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcd84c-de8d-4534-9047-2811096e34b8 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:55.245023 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1095/2205] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:55.667137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:55.669017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:55.753749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3af73-ac02-4de8-a2af-ccf3614385ed service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:55.758682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:55.760303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:55.760836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:55.761344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] PATH_INFO: `/v3/users/5d9b13c297f74bc8ad353bf77ca33477` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:55.762602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9b13c297f74bc8ad353bf77ca33477)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:55.764556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:55.817669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9b13c297f74bc8ad353bf77ca33477'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:55.830143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9b13c297f74bc8ad353bf77ca33477'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:55.831950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9b13c297f74bc8ad353bf77ca33477'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:55.846374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9b13c297f74bc8ad353bf77ca33477'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:55.847297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9b13c297f74bc8ad353bf77ca33477'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:55.870834 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1111/2206] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:55 2022] DELETE /identity/v3/users/5d9b13c297f74bc8ad353bf77ca33477 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:55.875377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:55.875969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:55.876425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:55.897563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:55.899168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:55.993180 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1096/2207] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:56.002193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:56.005176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:56.075938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699ecc-b070-484b-8a37-c42b7616f822 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:56.080640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:56.081595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:56.081991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:56.082879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:56.095760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:56.097622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:56.113203 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1112/2208] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:56.449951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:56.452434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:56.492206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b464-aa11-4500-8ced-32aa82d40b4f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:56.498295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:56.499167 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:56.499445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:56.499902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] PATH_INFO: `/v3/projects/2928fe61b3c44d84bfcaa690ba07b958` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:56.501301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2928fe61b3c44d84bfcaa690ba07b958)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:56.503387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:56.569898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2928fe61b3c44d84bfcaa690ba07b958', 'request_id': 'req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.580671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2928fe61b3c44d84bfcaa690ba07b958', 'request_id': 'req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.590228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2928fe61b3c44d84bfcaa690ba07b958', 'request_id': 'req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.623207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] The token cache is being invalidate because project 2928fe61b3c44d84bfcaa690ba07b958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:56.623878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.635568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.647497 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1097/2209] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:56 2022] DELETE /identity/v3/projects/2928fe61b3c44d84bfcaa690ba07b958 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:56.653614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:56.654570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:56.656671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:56.660241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:56.675826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc52d9-e585-4cac-9156-a81d6fa86429 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:56.779098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66cdcf-f6fc-4c19-ab0b-d8d8929abc2b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:56.780657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:56.782001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:56.782459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:56.782922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] PATH_INFO: `/v3/users/8079716ca8284a268887db3bcae39513` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:56.784527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:56.784910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8079716ca8284a268887db3bcae39513)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:56.785431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:56.785715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:56.785993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] PATH_INFO: `/v3/users/d305cf592cfe43e5be73796c2a61ca51` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:56.787228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d305cf592cfe43e5be73796c2a61ca51)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:56.788651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:56.789611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:56.792807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:56.848887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8079716ca8284a268887db3bcae39513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.856378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8079716ca8284a268887db3bcae39513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.857120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8079716ca8284a268887db3bcae39513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.858265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd305cf592cfe43e5be73796c2a61ca51'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.865649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8079716ca8284a268887db3bcae39513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.865882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd305cf592cfe43e5be73796c2a61ca51'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.866484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd305cf592cfe43e5be73796c2a61ca51'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.866710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f2957ad7-c627-41fe-8e3e-c18af8aac2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8079716ca8284a268887db3bcae39513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.881245 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd305cf592cfe43e5be73796c2a61ca51'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.890196 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd305cf592cfe43e5be73796c2a61ca51'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:56.891812 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1113/2210] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:56 2022] DELETE /identity/v3/users/8079716ca8284a268887db3bcae39513 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:56.897034 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1098/2211] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:56 2022] DELETE /identity/v3/users/d305cf592cfe43e5be73796c2a61ca51 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:56.903538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:56.903858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:56.904140 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:56.926266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:56.927491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.002011 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1114/2212] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:57.016182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:57.018258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.095670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eafed2-e308-4a64-85cf-0357e9e05eaf admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:57.099585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:57.100246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.100529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.100811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.112066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:57.113541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:57.127768 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1099/2213] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:48:57.403147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:57.404582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.441172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2190-851b-42c3-8846-2d3bd6cf3e01 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:57.455011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:57.456073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.456360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.456638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] PATH_INFO: `/v3/projects/19140632702c48bebe39f7ef690aaf42` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.460837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19140632702c48bebe39f7ef690aaf42)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:57.468721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:57.508599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:57.573913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19140632702c48bebe39f7ef690aaf42', 'request_id': 'req-f3c73c0c-d007-4172-89c7-310fddc79448'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.595941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19140632702c48bebe39f7ef690aaf42', 'request_id': 'req-f3c73c0c-d007-4172-89c7-310fddc79448'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.606033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19140632702c48bebe39f7ef690aaf42', 'request_id': 'req-f3c73c0c-d007-4172-89c7-310fddc79448'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.615054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:57.616756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.627058 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] The token cache is being invalidate because project 19140632702c48bebe39f7ef690aaf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:57.627266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.628086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f3c73c0c-d007-4172-89c7-310fddc79448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.629889 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1115/2214] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:57 2022] DELETE /identity/v3/projects/19140632702c48bebe39f7ef690aaf42 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:57.636718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9e2e-4a7f-44d8-b890-89143bff6e4f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.637425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9e2e-4a7f-44d8-b890-89143bff6e4f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.637918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9e2e-4a7f-44d8-b890-89143bff6e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.639798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5d95-a169-4a9e-a357-b487d6712b35 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:57.674713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5b1e9e2e-4a7f-44d8-b890-89143bff6e4f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:57.674713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5b1e9e2e-4a7f-44d8-b890-89143bff6e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.735282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:57.736160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.736447 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.736727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] PATH_INFO: `/v3/projects/85ed3d1de2774e02baeae4381780399f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.738743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ed3d1de2774e02baeae4381780399f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:57.751050 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1116/2215] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:57.760980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:57.766823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.767297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.769987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.790079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:57.791693 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.810359 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1117/2216] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:57.814345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:57.818890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:57.835524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ed3d1de2774e02baeae4381780399f', 'request_id': 'req-3d3a68c6-8741-4884-a213-d09c95ec70c9'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.840113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6707cc-ff60-47bd-bf5f-7e3aa0735e87 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:57.845599 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ed3d1de2774e02baeae4381780399f', 'request_id': 'req-3d3a68c6-8741-4884-a213-d09c95ec70c9'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.853741 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ed3d1de2774e02baeae4381780399f', 'request_id': 'req-3d3a68c6-8741-4884-a213-d09c95ec70c9'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.888537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] The token cache is being invalidate because project 85ed3d1de2774e02baeae4381780399f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:48:57.888879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.889641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3d3a68c6-8741-4884-a213-d09c95ec70c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:57.892349 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1100/2217] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:48:57 2022] DELETE /identity/v3/projects/85ed3d1de2774e02baeae4381780399f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:57.900087 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a165b19-3dca-44ab-b2c3-e20d41e71b4e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.900379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a165b19-3dca-44ab-b2c3-e20d41e71b4e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.900665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a165b19-3dca-44ab-b2c3-e20d41e71b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.937231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4a165b19-3dca-44ab-b2c3-e20d41e71b4e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:57.938347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4a165b19-3dca-44ab-b2c3-e20d41e71b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:57.940867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:57.943041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.943359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.943651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.944815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:57.945207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:57.957232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:57.957643 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1101/2218] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:57.962856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:57.963020 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1118/2219] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:57.963118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:57.963118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:57.965323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:57.968649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:58.001356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63033b-33f0-42fe-a618-e6cde193138e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.010950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:58.012683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:58.015018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.016088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.016411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.016694 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.019509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.027473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.051358 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1102/2220] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:58.053115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.074116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c08c4-47b1-4eea-a9b0-eb3515672c5f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.091685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.092605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.092911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.093552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.094466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:48:58.094788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.098732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.099295 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1119/2221] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:57 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:58.108269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.135872 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1103/2222] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:48:58.140882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.153796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:58.154897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1af88-43d3-4942-a2eb-da7a2e16a14a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.293112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fa30-82a9-43c5-be61-8527f0617189 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.308421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.310256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.310256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.310256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.310764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.312724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.366516 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1120/2223] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:58.371166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.387471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.388396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.388625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.388908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.389643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.391571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.391700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12fe8d-7317-4101-9733-3807b2885652 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.397044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.398081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.398266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.398654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.399594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.404678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.420963 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1121/2224] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:58.424870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.441795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98ee7-e0d5-4e36-a7d5-5a00f9f932a7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.465192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.465192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.465192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.465192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.465810 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.465886 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1104/2225] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/projects => generated 373 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:58.469575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.470302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.489341 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1122/2226] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:58.494136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.504759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333bfd-fb93-4663-8d44-513cb11e3fa7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.557641 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42c3b-03f8-40eb-9483-5d6ee1de7412 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.582179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.583593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.584045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.584768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.586120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.590377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.592184 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68f08f-7838-4601-86e3-3a9f80f331bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.593935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68f08f-7838-4601-86e3-3a9f80f331bd admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.594277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68f08f-7838-4601-86e3-3a9f80f331bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.594825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68f08f-7838-4601-86e3-3a9f80f331bd admin admin] PATH_INFO: `/v3/projects/8741688043eb4ece827d1d0c853c4bb5/users/08e5613972d2482fa5f14c024b4a9cd1/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.629120 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1105/2227] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:58.630834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.632864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68f08f-7838-4601-86e3-3a9f80f331bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8741688043eb4ece827d1d0c853c4bb5, user_id=08e5613972d2482fa5f14c024b4a9cd1, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.638600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68f08f-7838-4601-86e3-3a9f80f331bd admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.643184 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:58.651584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bd082-577c-4bac-b030-9b20a6f6dd2f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.667031 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1123/2228] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:58 2022] PUT /identity/v3/projects/8741688043eb4ece827d1d0c853c4bb5/users/08e5613972d2482fa5f14c024b4a9cd1/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:48:58.678585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.678689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.679128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.735126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] MFA Rules not processed for user `08e5613972d2482fa5f14c024b4a9cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:58.735942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:58.752547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.753311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.753599 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.753875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.754752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.756386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.767749 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1106/2229] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:58.772448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.787034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e92e-1c2e-4618-8017-2f399567f581 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.797751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.799548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.800146 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.800795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.801836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.804598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.817639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:58.825874 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1107/2230] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:58.827478 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.839790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43607-135c-455d-8bdf-9a76b860aace admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.844956 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1124/2231] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:58.846349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3276be-3d78-4360-bb12-4355bc7d9047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.847617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276be-3d78-4360-bb12-4355bc7d9047 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.848246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276be-3d78-4360-bb12-4355bc7d9047 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.848856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3276be-3d78-4360-bb12-4355bc7d9047 admin admin] PATH_INFO: `/v3/projects/0d69183d45fe4f1baa8f71d86c1d6375/users/2eabb186921a475b8aae82a55a3b35d5/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.849361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.861528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824570-a75a-42f5-b4e2-25644a66d1bd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:58.866435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:58.867177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.867624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.867948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.870014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.870950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3276be-3d78-4360-bb12-4355bc7d9047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d69183d45fe4f1baa8f71d86c1d6375, user_id=2eabb186921a475b8aae82a55a3b35d5, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:58.872225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.874085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3276be-3d78-4360-bb12-4355bc7d9047 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:58.891162 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1108/2232] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:58 2022] PUT /identity/v3/projects/0d69183d45fe4f1baa8f71d86c1d6375/users/2eabb186921a475b8aae82a55a3b35d5/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:58.905939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:58.905939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:58.905939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:58.921388 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1125/2233] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:58.925247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:58.935674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] MFA Rules not processed for user `2eabb186921a475b8aae82a55a3b35d5`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:58.937908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:59.014438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f49de-c88a-4845-8df9-2534a60ba776 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.027372 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1109/2234] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:48:59.039904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.041547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.041835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.042660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.042954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.044139 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.045915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.046841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:59.078617 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1126/2235] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:58 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:59.084939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.098031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf27cc5-0a83-430f-b6a2-bfab69363551 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.106809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.107664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.108204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.108617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.109947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.114795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.139999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317b48f-9a23-4ace-8cdd-078fa5a9debb None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.146322 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1127/2236] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:59.147176 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.148047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.148338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.148613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.158254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.160236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:59.164119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.167396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.176055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00f137-5015-4fab-bff5-1f36cff5be16 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.181379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0712de3-243f-46a7-a026-bcfc0eb1c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.182167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0712de3-243f-46a7-a026-bcfc0eb1c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.182514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0712de3-243f-46a7-a026-bcfc0eb1c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.182860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0712de3-243f-46a7-a026-bcfc0eb1c3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.183655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0712de3-243f-46a7-a026-bcfc0eb1c3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.184998 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1110/2237] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:48:59.185374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0712de3-243f-46a7-a026-bcfc0eb1c3a1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.197343 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1128/2238] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:48:59.202058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.214736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb56b-265d-497c-9182-c068b39ed521 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.223727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.224750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.225125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.225512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] PATH_INFO: `/v3/projects/8e622431104045d49bc462376cde4cc4/users/5b5629854f11422cb730c3f45b4d6ed3/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.245814 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e622431104045d49bc462376cde4cc4, user_id=5b5629854f11422cb730c3f45b4d6ed3, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.248995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.266141 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1111/2239] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:59 2022] PUT /identity/v3/projects/8e622431104045d49bc462376cde4cc4/users/5b5629854f11422cb730c3f45b4d6ed3/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:59.277864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.278222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.278504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.307313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] MFA Rules not processed for user `5b5629854f11422cb730c3f45b4d6ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:59.309668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:59.449970 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1129/2240] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:48:59.451434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.575523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.577748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:59.637204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd030452-fb6d-4f6b-9197-ef3eaea33071 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.646971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.652044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.653268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.653574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.657718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.660415 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.666791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:59.713193 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1112/2241] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:48:59 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:48:59.713405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050db266-d857-45d0-8848-68daa59a6f8a None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.716425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.797616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4e28-0577-4be8-aa3c-77e8eff3e0c0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.803537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.804219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.804504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.804782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.805551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.806472 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.807873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.807986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.808081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.808081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] PATH_INFO: `/v3/users/d3ec6d2726de482d8fe1de0689efe4e1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.809414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ec6d2726de482d8fe1de0689efe4e1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.811441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.830168 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1113/2242] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:48:59 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:48:59.834091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.846704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a9dc3-4f48-4a16-a682-f3c79d8ef544 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.852425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.854091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.854673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.854993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.855885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.857715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.870420 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1114/2243] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:48:59.880787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.882836 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ec6d2726de482d8fe1de0689efe4e1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:59.898888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ec6d2726de482d8fe1de0689efe4e1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:59.900537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ec6d2726de482d8fe1de0689efe4e1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:59.906343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2330b8-f2b1-42f3-b1e2-00adee2f4583 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:48:59.910481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ec6d2726de482d8fe1de0689efe4e1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:59.911068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-8a36e730-f7a7-47f2-a6fc-e21f970a5d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ec6d2726de482d8fe1de0689efe4e1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:48:59.913322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:48:59.914335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.914619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.914986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] PATH_INFO: `/v3/projects/998d7a99d3674b22b7a69274b2411623/users/25e8c67cc65e470d9fa5caaef05ae4c9/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.938420 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1130/2244] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:48:59 2022] DELETE /identity/v3/users/d3ec6d2726de482d8fe1de0689efe4e1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:59.938625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=998d7a99d3674b22b7a69274b2411623, user_id=25e8c67cc65e470d9fa5caaef05ae4c9, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:48:59.938625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:48:59.946042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:48:59.946634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:48:59.946930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:48:59.954416 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1115/2245] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:48:59 2022] PUT /identity/v3/projects/998d7a99d3674b22b7a69274b2411623/users/25e8c67cc65e470d9fa5caaef05ae4c9/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:48:59.959602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:48:59.961512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:59.967579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:48:59.969214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:48:59.976953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:00.027620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:00.045009 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1131/2246] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:00.055239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aa941-3a93-40e3-9be3-527aa3141d8b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:00.057290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:00.058841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.061748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:00.062564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.062855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.063304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.064053 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:00.066659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:00.078719 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1116/2247] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:49:00.082505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:00.093329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305102ee-4562-4946-b1fb-b0c6ec6a9f32 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:00.098719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb72c5b-3df8-433d-8ec0-dafe65c9c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:00.099707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb72c5b-3df8-433d-8ec0-dafe65c9c92a admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.100063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb72c5b-3df8-433d-8ec0-dafe65c9c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.100347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb72c5b-3df8-433d-8ec0-dafe65c9c92a admin admin] PATH_INFO: `/v3/projects/998d7a99d3674b22b7a69274b2411623/users/25e8c67cc65e470d9fa5caaef05ae4c9/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.103364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb72c5b-3df8-433d-8ec0-dafe65c9c92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=998d7a99d3674b22b7a69274b2411623, user_id=25e8c67cc65e470d9fa5caaef05ae4c9, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:00.106870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb72c5b-3df8-433d-8ec0-dafe65c9c92a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:00.120716 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1117/2248] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:00 2022] PUT /identity/v3/projects/998d7a99d3674b22b7a69274b2411623/users/25e8c67cc65e470d9fa5caaef05ae4c9/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:00.129006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe776c-fccd-4b6d-8123-ea5243d7964c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:00.135473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.135853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.136208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.169485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] MFA Rules not processed for user `25e8c67cc65e470d9fa5caaef05ae4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:00.173567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.216207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:00.217450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.218459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.218750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.286808 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1118/2249] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:00.295251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:00.296816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.302074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:00.303902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:00.316928 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1132/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:49:00.380265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e2e46-df74-4059-be38-f5fd39b810a3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:00.386102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:00.387048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.387343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.387630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.400492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:00.402251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:00.412700 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1119/2251] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:49:00.459482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:00.460929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.474820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47257f6-ab4d-4565-afdc-2422a624914d service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:00.481576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:00.485734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.485969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.486249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.488216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.563068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:00.565001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a787-c216-480e-a521-b85adedb8dd8 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:00.570286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:00.578750 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1133/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:00.652414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:00.653902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.691698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5e9f-5e66-4f65-9f85-828558d25210 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:00.697267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:00.697941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.698226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.698505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] PATH_INFO: `/v3/projects/8d0a5cdbf42940ce979f90928213cb12` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.699733 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0a5cdbf42940ce979f90928213cb12)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:00.703325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:00.716733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:00.716733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:00.716733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:00.742706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:00.745172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] MFA Rules not processed for user `2eabb186921a475b8aae82a55a3b35d5`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:00.752017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:00.785824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0a5cdbf42940ce979f90928213cb12', 'request_id': 'req-b5f169dc-e8e0-447e-9c32-d2c585966df3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:00.808037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0a5cdbf42940ce979f90928213cb12', 'request_id': 'req-b5f169dc-e8e0-447e-9c32-d2c585966df3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:00.822954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0a5cdbf42940ce979f90928213cb12', 'request_id': 'req-b5f169dc-e8e0-447e-9c32-d2c585966df3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:00.833838 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1134/2253] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:00.875761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] The token cache is being invalidate because project 8d0a5cdbf42940ce979f90928213cb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:00.876213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:00.880732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:00.882864 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1120/2254] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:00 2022] DELETE /identity/v3/projects/8d0a5cdbf42940ce979f90928213cb12 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:00.887643 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:00.905432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c696d6-c422-4050-8028-e48fd7337a49 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:01.005951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:01.007023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:01.007392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:01.007743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] PATH_INFO: `/v3/users/674c34ceabdb4170adaa9873c733d328` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:01.009803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=674c34ceabdb4170adaa9873c733d328)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:01.011827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:01.123680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674c34ceabdb4170adaa9873c733d328'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.132987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674c34ceabdb4170adaa9873c733d328'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.135198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674c34ceabdb4170adaa9873c733d328'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.146388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674c34ceabdb4170adaa9873c733d328'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.147091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674c34ceabdb4170adaa9873c733d328'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.168299 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1135/2255] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:00 2022] DELETE /identity/v3/users/674c34ceabdb4170adaa9873c733d328 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:01.513767 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:01.515238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:01.536764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f169dc-e8e0-447e-9c32-d2c585966df3 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:01.612503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:01.613425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:01.613786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:01.614137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] PATH_INFO: `/v3/projects/8a4142e97152447387058f906d1f474d` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:01.615462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4142e97152447387058f906d1f474d)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:01.617413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:01.676524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4142e97152447387058f906d1f474d', 'request_id': 'req-4353d503-646e-48fc-8f07-25ed1e5e5d2d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.683119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4142e97152447387058f906d1f474d', 'request_id': 'req-4353d503-646e-48fc-8f07-25ed1e5e5d2d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.689933 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4142e97152447387058f906d1f474d', 'request_id': 'req-4353d503-646e-48fc-8f07-25ed1e5e5d2d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.703855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] The token cache is being invalidate because project 8a4142e97152447387058f906d1f474d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:01.704173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.704806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.706442 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1121/2256] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:01 2022] DELETE /identity/v3/projects/8a4142e97152447387058f906d1f474d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:01.711650 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:01.713899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:01.726974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7f56-702c-4561-a351-c6446544a812 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:01.746830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:01.795104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:01.796238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:01.796575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:01.796821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] PATH_INFO: `/v3/users/199dc4fe695640eebf0495f1352ab548` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:01.798292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199dc4fe695640eebf0495f1352ab548)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:01.800378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:01.848099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199dc4fe695640eebf0495f1352ab548'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.856505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199dc4fe695640eebf0495f1352ab548'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.857231 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199dc4fe695640eebf0495f1352ab548'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.864891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199dc4fe695640eebf0495f1352ab548'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.865469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64084979-ac3d-4e61-87d7-2656e0ee4dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199dc4fe695640eebf0495f1352ab548'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:01.890640 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1136/2257] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:01 2022] DELETE /identity/v3/users/199dc4fe695640eebf0495f1352ab548 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:02.408215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:02.410472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:02.435239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d503-646e-48fc-8f07-25ed1e5e5d2d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:02.495806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:02.536799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:02.538645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:02.539000 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:02.539511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] PATH_INFO: `/v3/projects/e4536501cf25452c9abd00ad352c2342` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:02.541548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4536501cf25452c9abd00ad352c2342)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:02.544959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:02.654847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4536501cf25452c9abd00ad352c2342', 'request_id': 'req-48df06fa-5412-4076-842c-8268de0f159d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:02.663782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4536501cf25452c9abd00ad352c2342', 'request_id': 'req-48df06fa-5412-4076-842c-8268de0f159d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:02.685962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4536501cf25452c9abd00ad352c2342', 'request_id': 'req-48df06fa-5412-4076-842c-8268de0f159d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:02.715531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] The token cache is being invalidate because project e4536501cf25452c9abd00ad352c2342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:02.715888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:02.717058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-48df06fa-5412-4076-842c-8268de0f159d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:02.719890 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1122/2258] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:02 2022] DELETE /identity/v3/projects/e4536501cf25452c9abd00ad352c2342 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:02.727623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:02.728781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:02.730161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:02.794518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:02.795846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:02.883615 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1137/2259] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:02.885428 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:02.885717 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:02.885997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:02.906216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:02.907548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:02.916755 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1123/2260] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:02.921065 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:02.931318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab626026-a1a6-4d6d-8047-d3834fe444c8 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:02.936388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:02.937122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:02.937507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:02.937857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:02.938679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:02.939379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:02.940758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:02.953694 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1138/2261] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:49:02.958341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:02.974310 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e659-1734-46f9-8320-2d2c2714de3a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:02.980740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:02.981457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:02.981744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:02.982026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:02.982777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:02.984666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:03.016322 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1124/2262] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:02 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:49:03.021425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:03.038595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17f4e0-79d1-4cfc-b6da-e9c830c54058 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:03.070878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:03.116871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:03.117589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.117871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.118150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.119086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:03.121036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:03.142045 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1139/2263] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:03 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:03.146282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:03.157998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed977-2da5-4ce0-b8ae-bc14e8f2c35b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:03.163029 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:03.163699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.163989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.164275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.165039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:03.167216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:03.178706 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1125/2264] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:49:03.183399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:03.193856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d69ee-8628-482c-aff4-bf851a15e3a8 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:03.203717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3b8bd-b669-476e-bcfd-939b05148171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:03.205132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3b8bd-b669-476e-bcfd-939b05148171 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.205446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3b8bd-b669-476e-bcfd-939b05148171 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.205740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3b8bd-b669-476e-bcfd-939b05148171 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.206506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3b8bd-b669-476e-bcfd-939b05148171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:03.210224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3b8bd-b669-476e-bcfd-939b05148171 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:03.228464 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1140/2265] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:03.230185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:03.240880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cbb52-1316-41ed-b477-dbc07623cb25 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:03.247028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:03.247855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.247855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.248048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] PATH_INFO: `/v3/projects/f894226ce03c4512a633fac4618d82b2/users/dfea4e573d5449e6943b8700424f556b/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.270230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f894226ce03c4512a633fac4618d82b2, user_id=dfea4e573d5449e6943b8700424f556b, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:03.273022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:03.294393 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1126/2266] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:03 2022] PUT /identity/v3/projects/f894226ce03c4512a633fac4618d82b2/users/dfea4e573d5449e6943b8700424f556b/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:03.297391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.297700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.297975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.321993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:03.323239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:03.392565 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1141/2267] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:03.404235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:03.406485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:03.479597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e879-18ed-4697-a123-5aa1da935d65 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:03.483801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f18bc5-f289-4c25-a0a6-5936329e9f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:03.484531 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18bc5-f289-4c25-a0a6-5936329e9f00 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.484836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18bc5-f289-4c25-a0a6-5936329e9f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.485848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18bc5-f289-4c25-a0a6-5936329e9f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.499091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f18bc5-f289-4c25-a0a6-5936329e9f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:03.500562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f18bc5-f289-4c25-a0a6-5936329e9f00 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:03.511358 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1127/2268] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:03.930430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:03.932558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:03.956282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed3a4-6f52-46fe-97e5-b36c4c602b6f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:03.963362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:03.964695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:03.965381 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:03.966660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] PATH_INFO: `/v3/users/08e5613972d2482fa5f14c024b4a9cd1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:03.969033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e5613972d2482fa5f14c024b4a9cd1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:03.972239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:04.062048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e5613972d2482fa5f14c024b4a9cd1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.080597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e5613972d2482fa5f14c024b4a9cd1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.081531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e5613972d2482fa5f14c024b4a9cd1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.097711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e5613972d2482fa5f14c024b4a9cd1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.098707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e5613972d2482fa5f14c024b4a9cd1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.122180 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1142/2269] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:03 2022] DELETE /identity/v3/users/08e5613972d2482fa5f14c024b4a9cd1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:04.125949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:04.126470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:04.126470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:04.150149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:04.161236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:04.164918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:04.247156 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1128/2270] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:04.257352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:04.258894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:04.283273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:04.357544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922d491-0fbf-4695-a620-38a7a3175763 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:04.366623 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:04.367305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:04.367595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:04.367871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:04.388972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:04.390494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:04.403380 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1143/2271] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:04.772845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:04.774363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:04.792978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7328d-e236-434d-97e6-b6d5a19339c3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:04.805115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:04.806878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:04.807313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:04.807633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] PATH_INFO: `/v3/projects/8741688043eb4ece827d1d0c853c4bb5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:04.808865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8741688043eb4ece827d1d0c853c4bb5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:04.810856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:04.868737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8741688043eb4ece827d1d0c853c4bb5', 'request_id': 'req-771689a8-9234-4061-9ca4-6365cae7a465'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.875783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8741688043eb4ece827d1d0c853c4bb5', 'request_id': 'req-771689a8-9234-4061-9ca4-6365cae7a465'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.881645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8741688043eb4ece827d1d0c853c4bb5', 'request_id': 'req-771689a8-9234-4061-9ca4-6365cae7a465'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.894873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] The token cache is being invalidate because project 8741688043eb4ece827d1d0c853c4bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:04.895169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.895839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-771689a8-9234-4061-9ca4-6365cae7a465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:04.897550 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1129/2272] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:04 2022] DELETE /identity/v3/projects/8741688043eb4ece827d1d0c853c4bb5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:04.902289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:04.912314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e5c48-230d-4b06-b4f0-ed5e8c954d3f service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:04.982169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:04.986009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:04.987069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:04.987689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] PATH_INFO: `/v3/users/5b5629854f11422cb730c3f45b4d6ed3` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:04.988924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5629854f11422cb730c3f45b4d6ed3)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:04.992024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:05.110122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5629854f11422cb730c3f45b4d6ed3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.127187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5629854f11422cb730c3f45b4d6ed3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.127957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5629854f11422cb730c3f45b4d6ed3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.144761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5629854f11422cb730c3f45b4d6ed3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.145534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5629854f11422cb730c3f45b4d6ed3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.191751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:05.193695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:05.194222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:05.209998 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1144/2273] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:04 2022] DELETE /identity/v3/users/5b5629854f11422cb730c3f45b4d6ed3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:05.293644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] MFA Rules not processed for user `dfea4e573d5449e6943b8700424f556b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:05.295127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:05.415792 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1130/2274] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:05.420699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:05.423222 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:05.509492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:05.537796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00adf1-42ba-4d9f-a4e1-adaeb7d46e92 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:05.541857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:05.542616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:05.542900 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:05.543176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:05.557708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:05.559768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:05.589565 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1145/2275] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:49:05.723642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:05.725256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:05.756625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:05.862110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fba7c-682b-422d-9dbf-b2748c1eadd0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:05.867359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:05.868487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:05.868966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:05.869353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] PATH_INFO: `/v3/projects/8e622431104045d49bc462376cde4cc4` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:05.871606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e622431104045d49bc462376cde4cc4)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:05.873479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:05.949369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e622431104045d49bc462376cde4cc4', 'request_id': 'req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.958770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e622431104045d49bc462376cde4cc4', 'request_id': 'req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:05.968778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e622431104045d49bc462376cde4cc4', 'request_id': 'req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.001680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] The token cache is being invalidate because project 8e622431104045d49bc462376cde4cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:06.001898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.002842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.014141 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1131/2276] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:05 2022] DELETE /identity/v3/projects/8e622431104045d49bc462376cde4cc4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:06.018039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:06.033375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc1335-7908-40cb-806d-e3e2b78402fa service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:06.098174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:06.099221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:06.099625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:06.100009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] PATH_INFO: `/v3/users/25e8c67cc65e470d9fa5caaef05ae4c9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:06.101248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e8c67cc65e470d9fa5caaef05ae4c9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:06.103283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:06.154652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e8c67cc65e470d9fa5caaef05ae4c9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.162132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e8c67cc65e470d9fa5caaef05ae4c9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.162916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e8c67cc65e470d9fa5caaef05ae4c9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.171706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e8c67cc65e470d9fa5caaef05ae4c9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.172408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-998eb0db-e196-42fa-9986-ea7832aaf35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e8c67cc65e470d9fa5caaef05ae4c9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.191304 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1146/2277] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:06 2022] DELETE /identity/v3/users/25e8c67cc65e470d9fa5caaef05ae4c9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:06.480578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:06.483630 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:06.506535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8ac43-5c1a-4265-8dd2-b664e218d4e0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:06.580627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:06.581935 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:06.582399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:06.582832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] PATH_INFO: `/v3/projects/998d7a99d3674b22b7a69274b2411623` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:06.584228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998d7a99d3674b22b7a69274b2411623)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:06.586338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:06.645753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998d7a99d3674b22b7a69274b2411623', 'request_id': 'req-8b8a80d6-7f50-4db0-b9af-50762e61b188'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.646941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:06.654462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998d7a99d3674b22b7a69274b2411623', 'request_id': 'req-8b8a80d6-7f50-4db0-b9af-50762e61b188'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.660807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998d7a99d3674b22b7a69274b2411623', 'request_id': 'req-8b8a80d6-7f50-4db0-b9af-50762e61b188'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.675349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] The token cache is being invalidate because project 998d7a99d3674b22b7a69274b2411623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:06.675739 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.676411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8b8a80d6-7f50-4db0-b9af-50762e61b188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:06.678516 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1132/2278] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:06 2022] DELETE /identity/v3/projects/998d7a99d3674b22b7a69274b2411623 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:06.685196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:06.685494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:06.685778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:06.704439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:06.705695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:06.768812 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1147/2279] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:06.778126 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:06.778417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:06.778702 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:06.797283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:06.798487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:06.806790 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1133/2280] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:06.811020 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:06.817117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:06.823200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ff9ed-1f00-492d-8262-05db50793c26 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:06.830700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:06.831118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:06.831403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:06.831683 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:06.832446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:06.832767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:06.834950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:06.855100 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1148/2281] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:49:06.856618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:06.866050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c31b33-d416-43ff-97ff-c7aa175122f4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:06.873794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2d87c-0419-462b-884a-24e50c819560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:06.874658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d87c-0419-462b-884a-24e50c819560 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:06.874943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d87c-0419-462b-884a-24e50c819560 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:06.875366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d87c-0419-462b-884a-24e50c819560 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:06.876064 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2d87c-0419-462b-884a-24e50c819560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:06.878015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2d87c-0419-462b-884a-24e50c819560 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:06.913236 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1134/2282] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:06 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:06.914360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:06.926428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71acf-e28c-4e84-ae98-7c9f49c33a93 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.009734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.010824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.011208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.011638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.013192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.017019 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.052845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0032-094c-480f-b6f4-817425773735 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.053256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0032-094c-480f-b6f4-817425773735 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.053682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0032-094c-480f-b6f4-817425773735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.061980 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1149/2283] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:06 2022] POST /identity/v3/users => generated 281 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:49:07.066092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:07.078217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a2de0032-094c-480f-b6f4-817425773735 None None] MFA Rules not processed for user `dfea4e573d5449e6943b8700424f556b`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:07.079458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a2de0032-094c-480f-b6f4-817425773735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:07.083299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3f85-c1d2-4396-b526-cbdd921d8bcc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.092566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.093545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.094449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.094726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.095471 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.097093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.112944 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1150/2284] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:49:07.121131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:07.133275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d649-dcbb-4497-a39a-28ed2d27b3b7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.138519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.139203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.139458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.139754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.140459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.142094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.154028 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1151/2285] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:07.158235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:07.168411 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acc912-6bdc-4645-8fb6-67ab89a1df74 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.168896 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1135/2286] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:07.173225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.174092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.174370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.174642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] PATH_INFO: `/v3/projects/bdab518ed54840e0909f50993ca7a9b7/users/43e5b0d7f163415fbb65c4652c92395d/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.191271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdab518ed54840e0909f50993ca7a9b7, user_id=43e5b0d7f163415fbb65c4652c92395d, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.194269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.221037 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1152/2287] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:07 2022] PUT /identity/v3/projects/bdab518ed54840e0909f50993ca7a9b7/users/43e5b0d7f163415fbb65c4652c92395d/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:07.235270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.235681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.236052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.265858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] MFA Rules not processed for user `43e5b0d7f163415fbb65c4652c92395d`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:07.267253 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:07.358915 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1136/2288] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:07.392185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:07.394563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:07.459143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321e793-1659-424c-a903-436dea35f936 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.463531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685afe-7de5-40fb-b0b6-d6ae2e084541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.464194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685afe-7de5-40fb-b0b6-d6ae2e084541 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.464478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685afe-7de5-40fb-b0b6-d6ae2e084541 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.464754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685afe-7de5-40fb-b0b6-d6ae2e084541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.474907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e685afe-7de5-40fb-b0b6-d6ae2e084541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.476362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e685afe-7de5-40fb-b0b6-d6ae2e084541 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.485987 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1153/2289] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:07.500088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:07.548908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:07.577791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fa543-77c2-474a-9841-d56ae5b5dbad None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.582348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.583230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.583516 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.583803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] PATH_INFO: `/v3/users/43e5b0d7f163415fbb65c4652c92395d` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.585031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e5b0d7f163415fbb65c4652c92395d)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.587074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.636280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e5b0d7f163415fbb65c4652c92395d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:07.643173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e5b0d7f163415fbb65c4652c92395d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:07.643885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e5b0d7f163415fbb65c4652c92395d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:07.658287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e5b0d7f163415fbb65c4652c92395d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:07.670876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e5b0d7f163415fbb65c4652c92395d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:07.685204 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1137/2290] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:07 2022] DELETE /identity/v3/users/43e5b0d7f163415fbb65c4652c92395d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:07.686967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.687703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.687703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.704964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:07.706259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:07.745292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:07.778344 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1154/2291] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:07.788648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:07.791025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:07.906113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff9abb-86b0-42d7-bca6-986114f2e7b8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:07.911453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7ca0-5fe8-49dc-80f7-18cd97023863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:07.912301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7ca0-5fe8-49dc-80f7-18cd97023863 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:07.912588 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7ca0-5fe8-49dc-80f7-18cd97023863 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:07.912863 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7ca0-5fe8-49dc-80f7-18cd97023863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:07.932846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7ca0-5fe8-49dc-80f7-18cd97023863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:07.936341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7ca0-5fe8-49dc-80f7-18cd97023863 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:07.951732 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1138/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:08.337528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.345499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:08.358319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed24c2-29ea-4660-bee2-c9e67ad0a6a7 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.367023 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.367866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.368147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.368425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] PATH_INFO: `/v3/projects/bdab518ed54840e0909f50993ca7a9b7` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.369867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdab518ed54840e0909f50993ca7a9b7)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.371910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.425625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdab518ed54840e0909f50993ca7a9b7', 'request_id': 'req-29799e71-f973-4033-86dc-92a6c5ee44c6'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:08.432898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdab518ed54840e0909f50993ca7a9b7', 'request_id': 'req-29799e71-f973-4033-86dc-92a6c5ee44c6'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:08.439156 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdab518ed54840e0909f50993ca7a9b7', 'request_id': 'req-29799e71-f973-4033-86dc-92a6c5ee44c6'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:08.452258 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] The token cache is being invalidate because project bdab518ed54840e0909f50993ca7a9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:08.452547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:08.453205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-29799e71-f973-4033-86dc-92a6c5ee44c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:08.454780 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1155/2293] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:08 2022] DELETE /identity/v3/projects/bdab518ed54840e0909f50993ca7a9b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:08.460761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.461127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.461537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.492316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:08.493674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:08.557429 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1139/2294] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:08.565109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.565441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.565752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.584191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:08.585357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:08.593823 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1156/2295] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:08.598036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.608208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191883c-2563-4c37-8e9f-9861f6157db2 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.612785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.613462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.613750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.614026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.614747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:08.615054 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.616864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.619334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:08.634842 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1140/2296] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:49:08.639364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.648913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbd47-e6e0-4bdd-adf4-25ea94e2b2c2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.654557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.655199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.655483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.655761 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.656441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.658406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.684043 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1157/2297] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:08 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:08.687994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.697888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cdf5e-20b6-4cca-be33-9e571911bffd admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.764040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.764704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.764993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.765309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.766009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.767932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.796512 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1141/2298] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:08 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:08.797916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.809772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35527a0-f898-4a5d-82c2-9d48269dba08 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.814477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.815149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.815429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.815705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.816456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.818110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.828917 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1158/2299] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:08.832989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.844097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5a991-8567-405b-89e3-93264079d073 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.848684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f8263-960b-4c7a-9edf-414d7e0ae52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.849373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8263-960b-4c7a-9edf-414d7e0ae52a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.849660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8263-960b-4c7a-9edf-414d7e0ae52a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.850037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8263-960b-4c7a-9edf-414d7e0ae52a admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.850661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f8263-960b-4c7a-9edf-414d7e0ae52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.852234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f8263-960b-4c7a-9edf-414d7e0ae52a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.863467 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1142/2300] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:08.867701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:08.877950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681e34-dfd9-401e-8cb0-36cc4135762e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:08.882698 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:08.883578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.883885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.884287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] PATH_INFO: `/v3/projects/b23891b396aa4bfbaa94bb7479e95777/users/df0f83088b5e47b6ba5e0c81e80a85f6/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.902687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23891b396aa4bfbaa94bb7479e95777, user_id=df0f83088b5e47b6ba5e0c81e80a85f6, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:08.909725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:08.926152 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1159/2301] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:08 2022] PUT /identity/v3/projects/b23891b396aa4bfbaa94bb7479e95777/users/df0f83088b5e47b6ba5e0c81e80a85f6/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:08.936589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:08.936881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:08.938578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:08.972025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] MFA Rules not processed for user `df0f83088b5e47b6ba5e0c81e80a85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:08.974091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:09.059977 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1143/2302] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:09.073259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:09.075008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:09.149506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581905d-1bc2-4795-99ae-fb1832958804 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:09.154534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858cf3-1539-4044-9fc7-eb18fd534952 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:09.154534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858cf3-1539-4044-9fc7-eb18fd534952 service glance] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:09.155383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858cf3-1539-4044-9fc7-eb18fd534952 service glance] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:09.155383 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858cf3-1539-4044-9fc7-eb18fd534952 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:09.167035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e858cf3-1539-4044-9fc7-eb18fd534952 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:09.168647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e858cf3-1539-4044-9fc7-eb18fd534952 service glance] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:09.174721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:09.180344 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1160/2303] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:11.775181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:11.777279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:11.859321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a1af8-254e-4ddf-93c5-dedf5ff1f86d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:11.863062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:11.863715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:11.864081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:11.864576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:11.866435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:11.883260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:11.944840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:11.947854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:11.970339 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1144/2304] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:20.125338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fa51-8bc6-446e-a21f-52c38a1dd3cb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:20.125802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fa51-8bc6-446e-a21f-52c38a1dd3cb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:20.126077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fa51-8bc6-446e-a21f-52c38a1dd3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:20.141427 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:20.142892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:20.165478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1275fa51-8bc6-446e-a21f-52c38a1dd3cb None None] MFA Rules not processed for user `2335faffe08d4c75ab85aa124819c513`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:20.167476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1275fa51-8bc6-446e-a21f-52c38a1dd3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:20.249736 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1161/2305] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:20.337980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5194030-148e-4643-a0e2-d3a6c979c324 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:20.353400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:20.354492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:20.354993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:20.355305 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] PATH_INFO: `/v3/users/224d2921875a4fb281f47b56385546d3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:20.356864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=224d2921875a4fb281f47b56385546d3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:20.358855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:20.426133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224d2921875a4fb281f47b56385546d3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:20.434084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:20.438429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224d2921875a4fb281f47b56385546d3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:20.440356 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224d2921875a4fb281f47b56385546d3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:20.461234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224d2921875a4fb281f47b56385546d3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:20.474204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224d2921875a4fb281f47b56385546d3'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:20.484845 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1145/2306] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:20 2022] DELETE /identity/v3/users/224d2921875a4fb281f47b56385546d3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:20.489593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:20.490041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:20.490285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:20.520597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:20.521917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:20.591963 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1162/2307] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:20.602023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:20.603569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:20.733643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5bf7-8212-4981-824c-c70075080e4f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:20.743347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605199-7b5d-4bf3-8c6b-5553f656fe9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:20.746079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605199-7b5d-4bf3-8c6b-5553f656fe9e service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:20.746497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605199-7b5d-4bf3-8c6b-5553f656fe9e service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:20.746794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605199-7b5d-4bf3-8c6b-5553f656fe9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:20.761858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605199-7b5d-4bf3-8c6b-5553f656fe9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:20.763848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605199-7b5d-4bf3-8c6b-5553f656fe9e service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:20.774680 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1146/2308] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:21.320652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:21.322134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:21.349648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38407-2650-4f2d-bbde-f0f03c310ef0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:21.356554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:21.360094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:21.360619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:21.360826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] PATH_INFO: `/v3/projects/fb15ac0c70bf4abc952254fa20f8a4f9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:21.362585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb15ac0c70bf4abc952254fa20f8a4f9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:21.365508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:21.458536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb15ac0c70bf4abc952254fa20f8a4f9', 'request_id': 'req-3a53613d-9bc1-472d-9a64-0e1e62645da1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:21.465767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb15ac0c70bf4abc952254fa20f8a4f9', 'request_id': 'req-3a53613d-9bc1-472d-9a64-0e1e62645da1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:21.475894 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb15ac0c70bf4abc952254fa20f8a4f9', 'request_id': 'req-3a53613d-9bc1-472d-9a64-0e1e62645da1'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:21.481637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:21.498378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] The token cache is being invalidate because project fb15ac0c70bf4abc952254fa20f8a4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:21.499508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:21.500512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3a53613d-9bc1-472d-9a64-0e1e62645da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:21.505203 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1163/2309] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:21 2022] DELETE /identity/v3/projects/fb15ac0c70bf4abc952254fa20f8a4f9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:21.508350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:21.508812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:21.508975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:21.566820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:21.568251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:21.693857 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1147/2310] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:21.702653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:21.702965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:21.703243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:21.726941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:21.728191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:21.737419 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1164/2311] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:21.742077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:21.756514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95463e8b-e601-484e-ba4a-64cb45193167 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:21.763086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:21.766591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:21.767014 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:21.767414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:21.768554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:21.768967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:21.770764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:21.799643 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1148/2312] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:49:21.804733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:21.817294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000cf9a-0600-4831-9fa6-9149887a699c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:21.822905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:21.823157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:21.823483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:21.823807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:21.824561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:21.827557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:21.861908 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1165/2313] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:21 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:49:21.866038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:21.879372 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d681e-fd3d-44b0-9dfb-189490dcb940 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:21.890776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:22.036837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:22.037636 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:22.037840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:22.038685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:22.039396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:22.041403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:22.065719 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1149/2314] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:21 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:22.069764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:22.083151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24007-6ba1-4ebd-89e7-634f4f9e2d64 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:22.090001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:22.090703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:22.090991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:22.091282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:22.092014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:22.093981 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:22.107811 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1166/2315] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:22.111839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:22.122270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760ca1-3b0d-40dc-a89b-f7ca6f0abca8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:22.127311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436cd8b-dd35-4b93-9b9b-7aba8c26765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:22.128045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436cd8b-dd35-4b93-9b9b-7aba8c26765c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:22.128334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436cd8b-dd35-4b93-9b9b-7aba8c26765c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:22.128663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436cd8b-dd35-4b93-9b9b-7aba8c26765c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:22.129499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436cd8b-dd35-4b93-9b9b-7aba8c26765c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:22.130944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436cd8b-dd35-4b93-9b9b-7aba8c26765c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:22.144506 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1150/2316] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:49:22.148830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:22.161513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6169-c9b3-4d82-8825-ba93f19f1878 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:22.166756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:22.168038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:22.168445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:22.168849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] PATH_INFO: `/v3/projects/138b75f9014a4698b462d0c7483b9420/users/b4f6e3f8e0f2431888f20f91fb469c72/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:22.186724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138b75f9014a4698b462d0c7483b9420, user_id=b4f6e3f8e0f2431888f20f91fb469c72, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:22.190947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:22.207398 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1167/2317] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:22 2022] PUT /identity/v3/projects/138b75f9014a4698b462d0c7483b9420/users/b4f6e3f8e0f2431888f20f91fb469c72/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:22.212401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f873f9-46ed-4491-ae31-f46dcd8dea42 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:22.212689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f873f9-46ed-4491-ae31-f46dcd8dea42 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:22.212986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f873f9-46ed-4491-ae31-f46dcd8dea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:22.232250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d9f873f9-46ed-4491-ae31-f46dcd8dea42 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:22.233495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d9f873f9-46ed-4491-ae31-f46dcd8dea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:22.302049 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1151/2318] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:22.311946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:22.313859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:22.384915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198114b-04d4-4a1f-af03-999ba75a4389 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:22.391562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4579a-508d-4401-bd46-9c281014c973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:22.392267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4579a-508d-4401-bd46-9c281014c973 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:22.392551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4579a-508d-4401-bd46-9c281014c973 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:22.392825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4579a-508d-4401-bd46-9c281014c973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:22.404016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4579a-508d-4401-bd46-9c281014c973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:22.405584 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4579a-508d-4401-bd46-9c281014c973 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:22.416149 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1168/2319] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:23.514360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:23.515311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:23.515311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:23.544656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:23.547404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:23.591801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:23.592253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:23.592253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:23.631194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] MFA Rules not processed for user `b4f6e3f8e0f2431888f20f91fb469c72`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:23.632699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:23.654567 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1152/2320] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:23.716172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:23.718468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:23.721320 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1169/2321] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:23.734060 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:23.736331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:23.775106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:23.778198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:23.822579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aecf72-d790-4684-a5db-e8940da60547 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:23.827838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71be7f-8b5f-4995-9748-1a7d94e1b563 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:23.829664 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190aa1-652e-4dea-a3f5-6578a89cb443 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:23.830324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190aa1-652e-4dea-a3f5-6578a89cb443 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:23.830610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190aa1-652e-4dea-a3f5-6578a89cb443 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:23.830886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190aa1-652e-4dea-a3f5-6578a89cb443 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:23.835602 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:23.836263 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:23.836543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:23.836821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:23.846193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190aa1-652e-4dea-a3f5-6578a89cb443 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:23.847792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190aa1-652e-4dea-a3f5-6578a89cb443 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:23.851441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:23.853035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:23.858218 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1153/2322] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 12:49:23.869488 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1170/2323] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:49:24.434824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5511af-9831-47c2-a35f-a038891ed510 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:24.435114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5511af-9831-47c2-a35f-a038891ed510 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:24.435393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5511af-9831-47c2-a35f-a038891ed510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:24.453406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-eb5511af-9831-47c2-a35f-a038891ed510 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:24.454543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-eb5511af-9831-47c2-a35f-a038891ed510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:24.462123 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1154/2324] 10.222.0.45 () {58 vars in 967 bytes} [Mon May 23 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:24.475537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:24.489151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccf5f9-4a62-45fc-a786-74966286e1d0 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:24.494459 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:24.495453 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:24.495742 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:24.496108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:24.506127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:24.507711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:24.518750 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1171/2325] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 12:49:24.858423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441998ad-e901-4e2c-b3fa-8130fed97e56 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:24.859193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441998ad-e901-4e2c-b3fa-8130fed97e56 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:24.859635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441998ad-e901-4e2c-b3fa-8130fed97e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:24.887793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-441998ad-e901-4e2c-b3fa-8130fed97e56 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:24.889060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-441998ad-e901-4e2c-b3fa-8130fed97e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:24.900712 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1155/2326] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:24.916899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:24.939488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b9a74-2b90-458a-afae-3b49a5b67efb service swift] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:24.946406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683272b-62dd-4821-9e29-8344152c2415 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:24.947335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683272b-62dd-4821-9e29-8344152c2415 service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:24.948460 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683272b-62dd-4821-9e29-8344152c2415 service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:24.949332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683272b-62dd-4821-9e29-8344152c2415 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:24.960010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683272b-62dd-4821-9e29-8344152c2415 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:24.962252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683272b-62dd-4821-9e29-8344152c2415 service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:24.971924 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1172/2327] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:49:25.315726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:25.315839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:25.316048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:25.353870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] MFA Rules not processed for user `b4f6e3f8e0f2431888f20f91fb469c72`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:25.355158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:25.363338 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1156/2328] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:25.418223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f59e-7061-43cd-94eb-add7196da784 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:25.418510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f59e-7061-43cd-94eb-add7196da784 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:25.418914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f59e-7061-43cd-94eb-add7196da784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:25.438985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3fd7f59e-7061-43cd-94eb-add7196da784 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:25.440423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3fd7f59e-7061-43cd-94eb-add7196da784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:25.451746 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1173/2329] 10.222.0.45 () {58 vars in 967 bytes} [Mon May 23 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:25.468601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:25.487417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a806f3-5670-4e98-9f99-e7060a1beea3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:25.493518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:25.494440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:25.495595 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:25.496281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:25.509653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:25.512813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:25.523590 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1157/2330] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 12:49:27.298778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3838-b772-4979-84b4-0a6552216bbe None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:27.299311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3838-b772-4979-84b4-0a6552216bbe None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:27.299311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3838-b772-4979-84b4-0a6552216bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:27.350333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-578c3838-b772-4979-84b4-0a6552216bbe None None] MFA Rules not processed for user `dfea4e573d5449e6943b8700424f556b`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:27.351856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-578c3838-b772-4979-84b4-0a6552216bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:27.441691 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1174/2331] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:28.264525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:28.266136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:28.287870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f09f-3b6f-46d8-865f-97cad59e4f54 service swift] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:28.303314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:28.304856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:28.305303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:28.305593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] PATH_INFO: `/v3/users/2eabb186921a475b8aae82a55a3b35d5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:28.307061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eabb186921a475b8aae82a55a3b35d5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:28.309548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:28.374597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eabb186921a475b8aae82a55a3b35d5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.382659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eabb186921a475b8aae82a55a3b35d5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.383465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eabb186921a475b8aae82a55a3b35d5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.398808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eabb186921a475b8aae82a55a3b35d5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.412059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eabb186921a475b8aae82a55a3b35d5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.422445 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1158/2332] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:28 2022] DELETE /identity/v3/users/2eabb186921a475b8aae82a55a3b35d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:28.427275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:28.428616 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:28.429099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:28.453413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:28.454963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:28.535794 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1175/2333] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:28.550357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:28.551784 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:28.624094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ae0a-5946-47ad-a18c-880927230c70 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:28.627665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:28.628314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:28.628604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:28.628883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:28.639459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:28.640894 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:28.652583 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1159/2334] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:28.826038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:28.827196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:28.841200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0e1d2-8fce-4888-bee2-73a75ca61d2c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:28.847789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:28.849091 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:28.849555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:28.850009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] PATH_INFO: `/v3/projects/0d69183d45fe4f1baa8f71d86c1d6375` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:28.851396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d69183d45fe4f1baa8f71d86c1d6375)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:28.853384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:28.905780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:28.918057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d69183d45fe4f1baa8f71d86c1d6375', 'request_id': 'req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.924004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d69183d45fe4f1baa8f71d86c1d6375', 'request_id': 'req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.930362 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d69183d45fe4f1baa8f71d86c1d6375', 'request_id': 'req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.945018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] The token cache is being invalidate because project 0d69183d45fe4f1baa8f71d86c1d6375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:28.945334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.945968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:28.948159 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1176/2335] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:28 2022] DELETE /identity/v3/projects/0d69183d45fe4f1baa8f71d86c1d6375 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:36.541187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:36.542791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:36.553008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:36.557939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f6603-041e-45d5-82d6-df9af93004f3 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:36.642900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:36.644081 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:36.644452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:36.644889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] PATH_INFO: `/v3/users/f1877c8dc1af45d3b4015950f8e51718` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:36.646235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1877c8dc1af45d3b4015950f8e51718)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:36.649279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:36.705425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1877c8dc1af45d3b4015950f8e51718'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:36.714431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1877c8dc1af45d3b4015950f8e51718'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:36.715254 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1877c8dc1af45d3b4015950f8e51718'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:36.730850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1877c8dc1af45d3b4015950f8e51718'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:36.739505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1877c8dc1af45d3b4015950f8e51718'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:36.747972 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1160/2336] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:36 2022] DELETE /identity/v3/users/f1877c8dc1af45d3b4015950f8e51718 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:36.925581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:36.927041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:36.940855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1752-d27c-4ea2-8d63-1daf40eb5ae6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:37.008621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:37.009530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:37.009901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:37.010195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] PATH_INFO: `/v3/projects/cbfd0d4dd49c464bab39efeb0a87991d` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:37.011486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfd0d4dd49c464bab39efeb0a87991d)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:37.013697 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:37.084452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfd0d4dd49c464bab39efeb0a87991d', 'request_id': 'req-62e8bb83-1ff8-4ab6-b89f-3c7839223920'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.093295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfd0d4dd49c464bab39efeb0a87991d', 'request_id': 'req-62e8bb83-1ff8-4ab6-b89f-3c7839223920'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.101322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfd0d4dd49c464bab39efeb0a87991d', 'request_id': 'req-62e8bb83-1ff8-4ab6-b89f-3c7839223920'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.120239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] The token cache is being invalidate because project cbfd0d4dd49c464bab39efeb0a87991d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:37.120581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.121315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.123329 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1177/2337] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:36 2022] DELETE /identity/v3/projects/cbfd0d4dd49c464bab39efeb0a87991d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:37.127127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:37.128646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:37.146956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf70e54-573a-466a-bb67-0fd8dc4736e3 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:37.233816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:37.235075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:37.235357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:37.235690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] PATH_INFO: `/v3/users/6c2a9d4c88b14adf9cdb7d5d83cf58ca` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:37.237578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2a9d4c88b14adf9cdb7d5d83cf58ca)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:37.239099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:37.318950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:37.360088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2a9d4c88b14adf9cdb7d5d83cf58ca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.379058 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2a9d4c88b14adf9cdb7d5d83cf58ca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.379819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2a9d4c88b14adf9cdb7d5d83cf58ca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.396593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2a9d4c88b14adf9cdb7d5d83cf58ca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.411580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3b79d82c-2acf-4ae2-be14-1115f24e8489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2a9d4c88b14adf9cdb7d5d83cf58ca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:37.424828 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1161/2338] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:37 2022] DELETE /identity/v3/users/6c2a9d4c88b14adf9cdb7d5d83cf58ca => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:37.882254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:37.883701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:37.924495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8bb83-1ff8-4ab6-b89f-3c7839223920 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:38.010392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:38.025044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:38.026825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.027393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.027942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] PATH_INFO: `/v3/projects/c01b8bca094548ad8d08e57fea84b6d0` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.029606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01b8bca094548ad8d08e57fea84b6d0)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:38.032999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:38.091692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01b8bca094548ad8d08e57fea84b6d0', 'request_id': 'req-113ce931-5cff-48ee-be95-a6f5e04a966d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.098890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01b8bca094548ad8d08e57fea84b6d0', 'request_id': 'req-113ce931-5cff-48ee-be95-a6f5e04a966d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.107055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01b8bca094548ad8d08e57fea84b6d0', 'request_id': 'req-113ce931-5cff-48ee-be95-a6f5e04a966d'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.122444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] The token cache is being invalidate because project c01b8bca094548ad8d08e57fea84b6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:38.123175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.123809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-113ce931-5cff-48ee-be95-a6f5e04a966d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.125621 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1178/2339] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:37 2022] DELETE /identity/v3/projects/c01b8bca094548ad8d08e57fea84b6d0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:38.130620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.131162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.131405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.169173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:38.170729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:38.316267 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1162/2340] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:38.325310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.326582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.326582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.396442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:38.400398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:38.419163 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1179/2341] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:38.424280 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:38.445323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9fc26-ca70-41a2-a708-c8d52c5d083f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:38.452487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:38.453640 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.454400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.454784 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.455866 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:38.456275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:38.458747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:38.479907 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1163/2342] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:49:38.484922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:38.505729 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:38.507773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:38.510000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a0e7-93ef-4a57-ad24-c61238e1ec9d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:38.518101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:38.519437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.519437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.519930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.520847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:38.524561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b76c3-3cff-45dd-9f06-de3cac6cb932 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:38.528142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:38.530949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:38.532233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.532667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.533321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] PATH_INFO: `/v3/users/df0f83088b5e47b6ba5e0c81e80a85f6` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.535111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0f83088b5e47b6ba5e0c81e80a85f6)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:38.537485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:38.567822 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1180/2343] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:38 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:38.572111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:38.668989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0f83088b5e47b6ba5e0c81e80a85f6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.683906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d735be-e9a9-4e83-b63f-06c5ac4b77cf admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:38.684606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0f83088b5e47b6ba5e0c81e80a85f6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.686192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0f83088b5e47b6ba5e0c81e80a85f6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.698049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7233-4f7c-493a-a091-b285eb8f9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:38.698049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7233-4f7c-493a-a091-b285eb8f9057 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.698049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7233-4f7c-493a-a091-b285eb8f9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.698049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7233-4f7c-493a-a091-b285eb8f9057 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.698367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc7233-4f7c-493a-a091-b285eb8f9057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:38.698367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc7233-4f7c-493a-a091-b285eb8f9057 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:38.714211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0f83088b5e47b6ba5e0c81e80a85f6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.721542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:38.729293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-76808f30-4543-40bc-afa5-5d8e5a4b084f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0f83088b5e47b6ba5e0c81e80a85f6'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:38.746753 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1164/2344] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:38 2022] DELETE /identity/v3/users/df0f83088b5e47b6ba5e0c81e80a85f6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:38.754064 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1181/2345] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:38 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:49:38.755496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.755788 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.756271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.757711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:38.758313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:38.759160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:38.796692 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:38.798191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:38.809420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:38.810943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:38.893699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:38.908746 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1165/2346] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:38.909648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:38.911078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:38.935548 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1182/2347] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:38.938622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:38.942299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:39.032049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db58593-aeef-4f27-8fb7-271590670c7e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.037547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.038233 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.038519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.038799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.039536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.041762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.054561 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1166/2348] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:39.054561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:39.055543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:39.099129 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72007056-8ce4-4a92-8431-8a31c162144c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.107682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.108361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.108647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.108927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.128068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.130968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.134800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac4256-70c2-480d-b77a-529b3dab4179 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.142648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.143747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.143893 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1183/2349] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:49:39.144061 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.144494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.144844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:39.160818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc44-61b1-4c9b-a6f9-73ff919c0aca service swift] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.163850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.166545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.169970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da20c6-4731-480f-b990-6ab5da9da021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.171639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da20c6-4731-480f-b990-6ab5da9da021 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.171639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da20c6-4731-480f-b990-6ab5da9da021 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.171639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da20c6-4731-480f-b990-6ab5da9da021 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.172475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da20c6-4731-480f-b990-6ab5da9da021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.176250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da20c6-4731-480f-b990-6ab5da9da021 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.181732 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1167/2350] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:39.192432 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1184/2351] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:39.196817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:39.208748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c5458-8b5a-407a-8923-9337265a873a service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.216097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.217844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.218311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.219716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] PATH_INFO: `/v3/projects/551e6281771e49b8983e4c9958ef5940/users/6700befb8e364f8f9cbd75fe87260c5f/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.246858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=551e6281771e49b8983e4c9958ef5940, user_id=6700befb8e364f8f9cbd75fe87260c5f, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.249684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.298277 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1168/2352] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:39 2022] PUT /identity/v3/projects/551e6281771e49b8983e4c9958ef5940/users/6700befb8e364f8f9cbd75fe87260c5f/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:39.314289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.314728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.315056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.410854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] MFA Rules not processed for user `6700befb8e364f8f9cbd75fe87260c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:39.412746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:39.507146 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1185/2353] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:39.519083 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:39.521019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:39.528713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:39.624182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ccca5-b2d8-42c2-a0e9-e1538c535a4f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.628195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.628976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.629692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.630092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.641801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.643413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.662390 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1169/2354] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:39.685339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:39.757376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:39.777917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb709ab-d5c4-4207-988c-712a141b7f7e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.785030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.786701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.787021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.787401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] PATH_INFO: `/v3/users/6700befb8e364f8f9cbd75fe87260c5f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.788816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6700befb8e364f8f9cbd75fe87260c5f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.793289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.805037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:39.808105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:39.876511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a22e0-acbf-4956-8de9-648e5a2b352d service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:39.894443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:39.897527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:39.897830 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:39.898743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] PATH_INFO: `/v3/projects/b23891b396aa4bfbaa94bb7479e95777` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:39.902194 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23891b396aa4bfbaa94bb7479e95777)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:39.906997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:39.958375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6700befb8e364f8f9cbd75fe87260c5f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:39.969980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6700befb8e364f8f9cbd75fe87260c5f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:39.970869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6700befb8e364f8f9cbd75fe87260c5f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:39.982830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6700befb8e364f8f9cbd75fe87260c5f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:39.983399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9997e19c-08c4-4850-9c1f-2f2f168eeb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6700befb8e364f8f9cbd75fe87260c5f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:40.015325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23891b396aa4bfbaa94bb7479e95777', 'request_id': 'req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:40.023396 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1186/2355] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:39 2022] DELETE /identity/v3/users/6700befb8e364f8f9cbd75fe87260c5f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:40.028338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.028711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.029057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.031602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23891b396aa4bfbaa94bb7479e95777', 'request_id': 'req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:40.049910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23891b396aa4bfbaa94bb7479e95777', 'request_id': 'req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:40.061763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:40.063211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:40.076778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] The token cache is being invalidate because project b23891b396aa4bfbaa94bb7479e95777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:40.076778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:40.077564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-bfdb2286-be6d-4958-ab5c-9861a6d0b4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:40.080541 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1170/2356] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:39 2022] DELETE /identity/v3/projects/b23891b396aa4bfbaa94bb7479e95777 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:40.085113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92245-e6d0-4600-ac1c-626c275b66e3 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.085512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92245-e6d0-4600-ac1c-626c275b66e3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.085880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92245-e6d0-4600-ac1c-626c275b66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.124552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-95f92245-e6d0-4600-ac1c-626c275b66e3 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:40.125997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-95f92245-e6d0-4600-ac1c-626c275b66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:40.202745 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1187/2357] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:40.252332 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1171/2358] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:40.252850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:40.252850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:40.258374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492592a4-83da-4066-8340-4b261b18f324 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.260434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492592a4-83da-4066-8340-4b261b18f324 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.260974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492592a4-83da-4066-8340-4b261b18f324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.309924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-492592a4-83da-4066-8340-4b261b18f324 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:40.311139 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-492592a4-83da-4066-8340-4b261b18f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:40.338597 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1172/2359] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:40.339690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492592a4-83da-4066-8340-4b261b18f324 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:40.361836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492592a4-83da-4066-8340-4b261b18f324 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:40.372160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:40.372959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.373290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.373701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.374449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:40.374761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:40.383591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:40.390330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550864-28b3-4829-9a7b-c6de1842a8b2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:40.401197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:40.401878 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.402164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.402438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.419880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:40.421384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:40.428495 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1173/2360] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:49:40.435518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:40.445619 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1188/2361] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:40.450937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3e3b-bab1-41ca-be99-0ea6f9666feb admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:40.459936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:40.460635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.461522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.461654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.462342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:40.464597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:40.478077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:40.550477 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1174/2362] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:40 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:40.554428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:40.588233 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581e8b8-dd92-43e2-893a-e0cec919afda service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:40.660516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:40.810157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:40.811266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.811880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.812435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.813867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:40.816199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:40.855768 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1189/2363] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:40 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:40.860093 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:40.883727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b592-b4af-41f7-82d0-319b6613c933 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:40.894133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:40.894827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.895113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.895391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.896138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:40.897803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:40.924677 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1175/2364] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:40.929676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:40.943709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f72b2-7d0f-47c8-9175-f8d9775680e9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:40.953170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa649d-4d21-46ed-971a-2122fd2acfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:40.953938 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa649d-4d21-46ed-971a-2122fd2acfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:40.954333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa649d-4d21-46ed-971a-2122fd2acfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:40.957302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa649d-4d21-46ed-971a-2122fd2acfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:40.958494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa649d-4d21-46ed-971a-2122fd2acfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:40.958494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa649d-4d21-46ed-971a-2122fd2acfd4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:40.974993 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1190/2365] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:40.985925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:41.015805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9347-0c6c-4fe6-bd8f-0da5400d38ab admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:41.030020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:41.031094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:41.031688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:41.032822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] PATH_INFO: `/v3/projects/a0ef120b9d274ff4b3db10ea968e99d1/users/29b73578628342a6a5751a6cb6cb7a7e/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:41.060209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ef120b9d274ff4b3db10ea968e99d1, user_id=29b73578628342a6a5751a6cb6cb7a7e, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:41.063099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:41.101075 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1176/2366] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:40 2022] PUT /identity/v3/projects/a0ef120b9d274ff4b3db10ea968e99d1/users/29b73578628342a6a5751a6cb6cb7a7e/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:41.107372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:41.107664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:41.107944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:41.130360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:41.131593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:41.220320 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1191/2367] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:41.221998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:41.493963 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b74a5c-621f-42b4-8d29-8248974258a2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:41.517783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a51092-8e7d-4e96-8d59-5f30c6276059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:41.523359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a51092-8e7d-4e96-8d59-5f30c6276059 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:41.523837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a51092-8e7d-4e96-8d59-5f30c6276059 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:41.524134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a51092-8e7d-4e96-8d59-5f30c6276059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:41.548495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:41.550063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:41.571081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d16d28-3916-447e-bf7f-8f69da4f001c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:41.572775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a51092-8e7d-4e96-8d59-5f30c6276059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:41.580464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a51092-8e7d-4e96-8d59-5f30c6276059 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:41.582592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:41.583734 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:41.585454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:41.586010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] PATH_INFO: `/v3/projects/551e6281771e49b8983e4c9958ef5940` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:41.592405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=551e6281771e49b8983e4c9958ef5940)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:41.595605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:41.640900 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1177/2368] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:41.730371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551e6281771e49b8983e4c9958ef5940', 'request_id': 'req-42b12a01-594c-4f06-ab22-50ffffc44b67'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:41.743068 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551e6281771e49b8983e4c9958ef5940', 'request_id': 'req-42b12a01-594c-4f06-ab22-50ffffc44b67'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:41.762323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551e6281771e49b8983e4c9958ef5940', 'request_id': 'req-42b12a01-594c-4f06-ab22-50ffffc44b67'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:41.799843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] The token cache is being invalidate because project 551e6281771e49b8983e4c9958ef5940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:41.800587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:41.801800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-42b12a01-594c-4f06-ab22-50ffffc44b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:41.803984 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1192/2369] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:41 2022] DELETE /identity/v3/projects/551e6281771e49b8983e4c9958ef5940 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:41.823158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:41.824067 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:41.824515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:41.882175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:41.883411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:42.054004 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1178/2370] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:42.061545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188600dc-130a-42d5-b311-d80318573ffd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.061954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188600dc-130a-42d5-b311-d80318573ffd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.062333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188600dc-130a-42d5-b311-d80318573ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.096975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-188600dc-130a-42d5-b311-d80318573ffd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:42.101914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-188600dc-130a-42d5-b311-d80318573ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:42.125723 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1193/2371] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:42.129816 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:42.145820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a0897-c8af-492d-ab20-2521f4504948 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:42.154705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:42.157037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.157037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.157037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.157850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:49:42.158187 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:42.160089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:42.183966 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1179/2372] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:49:42.188241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188600dc-130a-42d5-b311-d80318573ffd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:42.207189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188600dc-130a-42d5-b311-d80318573ffd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:42.213487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:42.216421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.217636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.217636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.218365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:42.220364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:42.236398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:42.284797 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1194/2373] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:42 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:42.290471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:42.312773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eac2f0-f4c2-4624-b324-be626627ff89 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:42.407020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:42.468788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:42.470650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.471176 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.472220 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.473542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:42.475722 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:42.506350 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1180/2374] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:42 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:42.510984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:42.534219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e85dd-143c-4483-b3fb-46c1240365ed admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:42.578916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:42.579740 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.580041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.580337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.581085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:42.582813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:42.598801 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1195/2375] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:42.602003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:42.620951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bdb9-c281-4afe-adf6-d74229634f6c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:42.633443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a9492-bcb0-4cbd-b58c-64aebe8aac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:42.634136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a9492-bcb0-4cbd-b58c-64aebe8aac96 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.634423 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a9492-bcb0-4cbd-b58c-64aebe8aac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.635386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a9492-bcb0-4cbd-b58c-64aebe8aac96 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.636132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a9492-bcb0-4cbd-b58c-64aebe8aac96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:42.637799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a9492-bcb0-4cbd-b58c-64aebe8aac96 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:42.663606 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1181/2376] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:42.665079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:42.696166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2be1-5ab9-4307-a10b-34a0fb3da374 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:42.705831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:42.706929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.707291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.707678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] PATH_INFO: `/v3/projects/37ffec7ab09a4a0c9ec9a4c7d3b7794c/users/a793c22f797a4b9d8bd7545dc9e722a8/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.740796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ffec7ab09a4a0c9ec9a4c7d3b7794c, user_id=a793c22f797a4b9d8bd7545dc9e722a8, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:42.743559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:42.774154 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1196/2377] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:42 2022] PUT /identity/v3/projects/37ffec7ab09a4a0c9ec9a4c7d3b7794c/users/a793c22f797a4b9d8bd7545dc9e722a8/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:42.784950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d81d0e-f775-4238-b7dd-cb6c498cc658 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:42.785325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d81d0e-f775-4238-b7dd-cb6c498cc658 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:42.785646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d81d0e-f775-4238-b7dd-cb6c498cc658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:42.841523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-18d81d0e-f775-4238-b7dd-cb6c498cc658 None None] MFA Rules not processed for user `a793c22f797a4b9d8bd7545dc9e722a8`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:42.843798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-18d81d0e-f775-4238-b7dd-cb6c498cc658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:42.986871 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1182/2378] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:43.000786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:43.002598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:43.121507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdec25-f1b6-4a9b-94a8-cb52c59a0596 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:43.128802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:43.128802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:43.129412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:43.129529 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:43.143928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:43.146669 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:43.161935 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1197/2379] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:52.450852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:52.451458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:52.451458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:52.486330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] MFA Rules not processed for user `29b73578628342a6a5751a6cb6cb7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:52.487619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:52.703930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:52.708502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:52.710465 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1183/2380] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:52.864600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a25e5a-bb3b-4823-9b6e-9f31b3d99979 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:52.868348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:52.869221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:52.869613 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:52.870008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:52.870713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:52.876628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:52.952574 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1198/2381] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:49:52 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:52.955922 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:52.987945 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b6439-3cb7-44ee-90b3-4fe3d6adf742 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:53.123312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:53.155730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:53.156978 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:53.157460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:53.157926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:53.158737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:53.161613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:53.215365 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1184/2382] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:49:52 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:49:53.216255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:53.235305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b81e2-cec1-4072-ae0b-cc3cb0add0e9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:53.248206 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:53.249016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:53.249538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:53.249897 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:53.250723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:53.254989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:53.301536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:53.312467 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1199/2383] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:49:53.316886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8945df-0e41-438f-9dce-1a54c469aedb admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:53.344252 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:53.347404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:53.349290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:53.349290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] PATH_INFO: `/v3/projects/c27477c55ec540fb9870e4737abe9320/users/344d82e4d05443ba9d0248928d883a2e/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:53.383047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27477c55ec540fb9870e4737abe9320, user_id=344d82e4d05443ba9d0248928d883a2e, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:53.406214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:53.450747 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1185/2384] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:53 2022] PUT /identity/v3/projects/c27477c55ec540fb9870e4737abe9320/users/344d82e4d05443ba9d0248928d883a2e/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:49:53.454741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:53.483824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf1c97-db05-4844-b547-62351e98e1cb admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:53.617552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:53.725827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff81d1-2dcd-4e93-8d62-eeba880c4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:53.728962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff81d1-2dcd-4e93-8d62-eeba880c4858 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:53.731661 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff81d1-2dcd-4e93-8d62-eeba880c4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:53.732211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff81d1-2dcd-4e93-8d62-eeba880c4858 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:53.733883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff81d1-2dcd-4e93-8d62-eeba880c4858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:53.739277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff81d1-2dcd-4e93-8d62-eeba880c4858 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:53.766358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:53.780370 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1200/2385] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:49:53.797181 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef28be-b781-4bd3-94e1-4b48fd86f562 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:53.814355 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:53.816036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:53.816406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:53.816757 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] PATH_INFO: `/v3/projects/c27477c55ec540fb9870e4737abe9320/users/344d82e4d05443ba9d0248928d883a2e/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:53.823513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27477c55ec540fb9870e4737abe9320, user_id=344d82e4d05443ba9d0248928d883a2e, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:53.826468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:53.865608 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1186/2386] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:49:53 2022] PUT /identity/v3/projects/c27477c55ec540fb9870e4737abe9320/users/344d82e4d05443ba9d0248928d883a2e/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:56.589866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:56.590429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:56.590429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:56.629270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:56.631289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:56.785108 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1201/2387] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:49:56.801189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:56.804136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:57.026656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c10da-5a46-438f-99fd-07fb4e4ee19c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:57.043748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752e6d-8bac-4e15-9a06-9a6225106a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:57.043748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752e6d-8bac-4e15-9a06-9a6225106a26 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:57.043748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752e6d-8bac-4e15-9a06-9a6225106a26 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:57.043748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752e6d-8bac-4e15-9a06-9a6225106a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:57.075829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:57.116783 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b752e6d-8bac-4e15-9a06-9a6225106a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:57.128048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b752e6d-8bac-4e15-9a06-9a6225106a26 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:57.139775 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1187/2388] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:49:57.333763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cebcb-0fad-4ff3-80eb-958a4aa03245 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:57.345753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:57.346873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:57.355958 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:57.356503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] PATH_INFO: `/v3/users/a793c22f797a4b9d8bd7545dc9e722a8` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:57.358785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a793c22f797a4b9d8bd7545dc9e722a8)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:57.362275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:57.504014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a793c22f797a4b9d8bd7545dc9e722a8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:57.536625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a793c22f797a4b9d8bd7545dc9e722a8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:57.537468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a793c22f797a4b9d8bd7545dc9e722a8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:57.565374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a793c22f797a4b9d8bd7545dc9e722a8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:57.566069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a793c22f797a4b9d8bd7545dc9e722a8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:57.574884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:57.611155 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1202/2389] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:49:57 2022] DELETE /identity/v3/users/a793c22f797a4b9d8bd7545dc9e722a8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:49:57.616511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:57.616737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:57.617038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:57.670668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:49:57.676443 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:57.865559 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1188/2390] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:49:57.911795 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:57.913914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:58.063839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831fe50-b811-48cc-83e8-025c79afb4fd admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:58.087716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91124401-fd40-4ab7-b806-3f2f68063528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:58.088399 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124401-fd40-4ab7-b806-3f2f68063528 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:58.088687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124401-fd40-4ab7-b806-3f2f68063528 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:58.088967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124401-fd40-4ab7-b806-3f2f68063528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:58.130791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91124401-fd40-4ab7-b806-3f2f68063528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:58.132936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91124401-fd40-4ab7-b806-3f2f68063528 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:58.173763 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1203/2391] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:49:58.989987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:49:58.990605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:49:59.026862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb328-5c38-41c9-a04a-e7f512690c7b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:49:59.044661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:49:59.046129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:49:59.048842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:49:59.049283 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] PATH_INFO: `/v3/projects/37ffec7ab09a4a0c9ec9a4c7d3b7794c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:49:59.053707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ffec7ab09a4a0c9ec9a4c7d3b7794c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:49:59.056568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:49:59.206824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:59.336686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ffec7ab09a4a0c9ec9a4c7d3b7794c', 'request_id': 'req-0d09e401-1ce5-483f-a824-e87f1669f072'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:59.370698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ffec7ab09a4a0c9ec9a4c7d3b7794c', 'request_id': 'req-0d09e401-1ce5-483f-a824-e87f1669f072'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:59.382789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ffec7ab09a4a0c9ec9a4c7d3b7794c', 'request_id': 'req-0d09e401-1ce5-483f-a824-e87f1669f072'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:59.429213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] The token cache is being invalidate because project 37ffec7ab09a4a0c9ec9a4c7d3b7794c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:49:59.429890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:59.431565 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:49:59.436791 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1189/2392] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:49:58 2022] DELETE /identity/v3/projects/37ffec7ab09a4a0c9ec9a4c7d3b7794c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:50:03.209792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520df7-eac6-46b6-afb1-f94408f4cccb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:03.210784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520df7-eac6-46b6-afb1-f94408f4cccb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:03.211321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520df7-eac6-46b6-afb1-f94408f4cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:03.253885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7b520df7-eac6-46b6-afb1-f94408f4cccb None None] MFA Rules not processed for user `344d82e4d05443ba9d0248928d883a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:03.255237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7b520df7-eac6-46b6-afb1-f94408f4cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:03.351889 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1204/2393] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:03.362953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:03.364535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:03.444210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e401-1ce5-483f-a824-e87f1669f072 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:03.448956 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:03.449769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:03.450124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:03.450798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:03.455760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:03.557872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:03.560234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:03.571092 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1190/2394] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:03.741409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af81947-4e7e-4354-93be-fa4e325cc93a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:03.741409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af81947-4e7e-4354-93be-fa4e325cc93a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:03.741409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af81947-4e7e-4354-93be-fa4e325cc93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:03.762947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6af81947-4e7e-4354-93be-fa4e325cc93a None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:03.764252 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6af81947-4e7e-4354-93be-fa4e325cc93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:03.882091 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1205/2395] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:03.899258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:03.901563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:04.063451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:04.067379 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354480-137e-47b5-85ff-67c251ca8d0e service glance] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:04.074705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87879b8f-bdce-4d82-a311-f6b1deb65476 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:04.075618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87879b8f-bdce-4d82-a311-f6b1deb65476 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:04.076364 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87879b8f-bdce-4d82-a311-f6b1deb65476 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:04.076785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87879b8f-bdce-4d82-a311-f6b1deb65476 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:04.088088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87879b8f-bdce-4d82-a311-f6b1deb65476 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:04.091241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87879b8f-bdce-4d82-a311-f6b1deb65476 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:04.102120 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1191/2396] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:50:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:50:06.941173 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e830-006b-41a2-b065-c884e5a026f0 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:06.941786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e830-006b-41a2-b065-c884e5a026f0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:06.941786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e830-006b-41a2-b065-c884e5a026f0 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:06.943437 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1206/2397] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:50:06.968624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:06.969773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:06.970365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:07.124564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:07.131429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:07.332926 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1192/2398] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:07.657043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba44f-4c70-43a8-812a-5f42811c52a8 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:07.657488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba44f-4c70-43a8-812a-5f42811c52a8 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:07.657895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba44f-4c70-43a8-812a-5f42811c52a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:07.692187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-68cba44f-4c70-43a8-812a-5f42811c52a8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:07.698120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-68cba44f-4c70-43a8-812a-5f42811c52a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:07.735622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:07.855773 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1207/2399] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:07.870004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:07.873189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:07.896621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74d461-b5bf-4954-8dac-07c4249cbadf None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:07.918473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:07.925362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:07.929617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:07.930257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:07.956109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:07.963770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:07.990145 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1193/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:11.951985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb467-120b-4911-9d5e-2002126fb737 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:11.953109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb467-120b-4911-9d5e-2002126fb737 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:11.953625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb467-120b-4911-9d5e-2002126fb737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:11.991511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c42eb467-120b-4911-9d5e-2002126fb737 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:11.996944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c42eb467-120b-4911-9d5e-2002126fb737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:12.027392 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1208/2401] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:12.045376 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:12.046781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:12.067533 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4ddcf-9885-42f6-ba6e-5212e250c8d3 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:12.074097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:12.074766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:12.075051 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:12.075339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:12.089957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:12.091858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:12.104602 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1194/2402] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:15.501325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:15.502344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:15.502955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:15.541171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:15.544069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:15.558187 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1209/2403] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:15.577336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:15.595547 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f45a4-d77a-4533-afb2-5e90af297a7c service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:15.601823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22848f-a012-4445-8d9c-ee6270d439dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:15.606028 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22848f-a012-4445-8d9c-ee6270d439dd service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:15.606551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22848f-a012-4445-8d9c-ee6270d439dd service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:15.606991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22848f-a012-4445-8d9c-ee6270d439dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:15.618513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22848f-a012-4445-8d9c-ee6270d439dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:15.620684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22848f-a012-4445-8d9c-ee6270d439dd service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:15.651955 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1195/2404] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:17.146540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:17.183107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f9ed8-38ab-4b85-99dd-646d5063c2cb None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:17.188121 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166cf3-eafe-4df5-b5f4-a88e141a1129 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:17.189378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166cf3-eafe-4df5-b5f4-a88e141a1129 service glance] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.195093 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166cf3-eafe-4df5-b5f4-a88e141a1129 service glance] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.196893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166cf3-eafe-4df5-b5f4-a88e141a1129 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.208250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5448-492c-4f5d-bdd3-732accfedfa2 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.208786 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5448-492c-4f5d-bdd3-732accfedfa2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.208885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5448-492c-4f5d-bdd3-732accfedfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.226318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166cf3-eafe-4df5-b5f4-a88e141a1129 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:17.230044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166cf3-eafe-4df5-b5f4-a88e141a1129 service glance] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:17.243800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a0cf5448-492c-4f5d-bdd3-732accfedfa2 None None] MFA Rules not processed for user `29b73578628342a6a5751a6cb6cb7a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:17.246849 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a0cf5448-492c-4f5d-bdd3-732accfedfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:17.266395 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1210/2405] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:17.280716 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1196/2406] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:17.404326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f873-ff7c-4ac6-9a09-978f898e4b54 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.404840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f873-ff7c-4ac6-9a09-978f898e4b54 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.405346 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f873-ff7c-4ac6-9a09-978f898e4b54 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.407268 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1211/2407] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:50:17.416896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9306ba-37b0-4f6f-bc06-ed5af2b6a757 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.417212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9306ba-37b0-4f6f-bc06-ed5af2b6a757 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.418517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9306ba-37b0-4f6f-bc06-ed5af2b6a757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.448687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ae9306ba-37b0-4f6f-bc06-ed5af2b6a757 None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:17.450338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ae9306ba-37b0-4f6f-bc06-ed5af2b6a757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:17.582143 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1197/2408] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:17.597649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f873-ff7c-4ac6-9a09-978f898e4b54 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:17.599582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e820f873-ff7c-4ac6-9a09-978f898e4b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:17.623213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f873-ff7c-4ac6-9a09-978f898e4b54 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:17.627871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6aec3-be52-45d5-910e-fc6c361b0d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:17.628942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6aec3-be52-45d5-910e-fc6c361b0d11 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.629516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6aec3-be52-45d5-910e-fc6c361b0d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.630011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6aec3-be52-45d5-910e-fc6c361b0d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.641467 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6aec3-be52-45d5-910e-fc6c361b0d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:17.643318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6aec3-be52-45d5-910e-fc6c361b0d11 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:17.665999 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1212/2409] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:17.815202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e09b6-4517-4ea2-a1e3-5e0dfdc3416f None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.815551 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e09b6-4517-4ea2-a1e3-5e0dfdc3416f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.815790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e09b6-4517-4ea2-a1e3-5e0dfdc3416f None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.817842 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1198/2410] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:50:17.828537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cf7b-2295-4937-a253-e47b9a52dda7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.829214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cf7b-2295-4937-a253-e47b9a52dda7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.829772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cf7b-2295-4937-a253-e47b9a52dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.857074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7598cf7b-2295-4937-a253-e47b9a52dda7 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:17.858799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7598cf7b-2295-4937-a253-e47b9a52dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:17.875389 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1213/2411] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:50:17.890629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e09b6-4517-4ea2-a1e3-5e0dfdc3416f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:17.910675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e09b6-4517-4ea2-a1e3-5e0dfdc3416f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:17.915567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:17.916684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:17.917218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:17.917696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:17.929613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:17.931959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:17.940348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:17.948242 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1199/2412] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:18.611289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df397a-a705-455c-bb47-86d91360f85a None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:18.611884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df397a-a705-455c-bb47-86d91360f85a None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:18.611995 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df397a-a705-455c-bb47-86d91360f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:18.649648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-13df397a-a705-455c-bb47-86d91360f85a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:18.652492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-13df397a-a705-455c-bb47-86d91360f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:18.690463 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1214/2413] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:18.712169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:18.732510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368d1a0-92df-475d-b205-aee9b6990a68 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:18.749113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:18.750110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:18.750560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:18.751182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:18.783557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:18.785236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:18.811343 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1200/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:20.320281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cb31-d131-430e-939d-2bc426142de5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:20.320796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cb31-d131-430e-939d-2bc426142de5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:20.326978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cb31-d131-430e-939d-2bc426142de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:20.385124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7631cb31-d131-430e-939d-2bc426142de5 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:20.386368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7631cb31-d131-430e-939d-2bc426142de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:20.403180 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1215/2415] 10.222.0.45 () {58 vars in 967 bytes} [Mon May 23 12:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:50:20.415317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:20.436529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297494f-faca-435c-ab44-c1dd45bdc24d service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:20.441633 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:20.442272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:20.442559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:20.442862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:20.452157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:20.453968 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:20.462123 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1201/2416] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:50:22.725921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa33b34-1fe0-48d3-a659-63b5d0e41f9b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:22.726419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa33b34-1fe0-48d3-a659-63b5d0e41f9b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:22.726514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa33b34-1fe0-48d3-a659-63b5d0e41f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:22.750384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7fa33b34-1fe0-48d3-a659-63b5d0e41f9b None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:22.752027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7fa33b34-1fe0-48d3-a659-63b5d0e41f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:22.775767 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1216/2417] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:22.814227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:22.829459 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec24d7-091b-4aea-9f0a-214850216de1 service swift] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:22.831677 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:22.831985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:22.832256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:22.832898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:22.833806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:22.834264 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:22.834513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:22.845424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:22.847881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:22.858770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:22.859306 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1202/2418] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:50:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:50:22.860186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:22.875658 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1217/2419] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:22.910015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:22.930079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527990-5140-4b09-bdc6-88231c391124 service swift] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:22.949258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:22.950325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:22.951040 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:22.951481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:22.958017 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:22.960221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:22.974256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:22.975862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:22.991167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703423f4-192f-44d7-9d17-0339574cc6e6 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:23.004633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:23.006522 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1203/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:23.008410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:23.008864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:23.010326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] PATH_INFO: `/v3/users/dfea4e573d5449e6943b8700424f556b` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:23.015644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfea4e573d5449e6943b8700424f556b)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:23.022452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:23.157726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfea4e573d5449e6943b8700424f556b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.176367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfea4e573d5449e6943b8700424f556b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.177557 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfea4e573d5449e6943b8700424f556b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.185704 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:23.201221 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfea4e573d5449e6943b8700424f556b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.202029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1e29c82e-453d-48a0-b9df-69e44dd78eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfea4e573d5449e6943b8700424f556b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.239652 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1218/2421] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:50:22 2022] DELETE /identity/v3/users/dfea4e573d5449e6943b8700424f556b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:50:23.485858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:23.496927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a408df-fa16-44d1-9c4b-17334cba895f service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:23.584070 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:23.584936 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:23.585248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:23.585573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] PATH_INFO: `/v3/projects/f894226ce03c4512a633fac4618d82b2` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:23.587016 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f894226ce03c4512a633fac4618d82b2)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:23.589511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:23.661911 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f894226ce03c4512a633fac4618d82b2', 'request_id': 'req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.671290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f894226ce03c4512a633fac4618d82b2', 'request_id': 'req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.678692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f894226ce03c4512a633fac4618d82b2', 'request_id': 'req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.697763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] The token cache is being invalidate because project f894226ce03c4512a633fac4618d82b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:50:23.698063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.699899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:50:23.701767 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1204/2422] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:50:23 2022] DELETE /identity/v3/projects/f894226ce03c4512a633fac4618d82b2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:50:33.234644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=3,keystone:SELECT=8 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:33.693111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:36.552558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319ced-ffe8-4266-926e-318794f760c3 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:36.553644 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319ced-ffe8-4266-926e-318794f760c3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:36.553924 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319ced-ffe8-4266-926e-318794f760c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:36.573525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-90319ced-ffe8-4266-926e-318794f760c3 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:36.575035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-90319ced-ffe8-4266-926e-318794f760c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:36.643653 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1219/2423] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:36.656559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:36.658056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:36.767507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54bf64-8f9a-4eb6-89c7-01edb00327eb admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:36.772986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:36.773675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:36.775018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:36.775018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:36.787676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:36.789301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:36.802591 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1205/2424] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:50:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:50:37.415278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3052a3-94b4-4367-bf6f-8b616a9b5978 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:37.415581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3052a3-94b4-4367-bf6f-8b616a9b5978 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:37.415834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3052a3-94b4-4367-bf6f-8b616a9b5978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:37.457513 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-be3052a3-94b4-4367-bf6f-8b616a9b5978 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:37.458748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-be3052a3-94b4-4367-bf6f-8b616a9b5978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:37.579434 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1220/2425] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:37.596619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:37.599813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:37.705286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132f8b-fdee-4366-9798-c1ce8700b578 service swift] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:37.721452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:37.722206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:37.722563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:37.722928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:37.735072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:37.736910 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:37.760486 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1206/2426] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:41.058959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:41.059560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:41.059560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:41.089800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] MFA Rules not processed for user `e90f349f384245fb8a118be176ad6829`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:50:41.092081 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:41.167198 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1221/2427] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:50:47.744385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=71 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:47.999222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:48.001213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:48.028208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:50:48.030225 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:48.119594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905b617-d8fd-4c51-be72-9b6221e185a0 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:48.121589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:48.125200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:48.126117 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:48.126596 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:48.126878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:48.128726 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:50:48.141416 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e480de-0bbc-4c84-b678-26e629bebb8c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:50:48.141623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:48.143463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f53c55-1d8e-4f41-9611-ea18afd77856 service placement] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:48.146572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:50:48.147211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:50:48.147492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:50:48.147766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:50:48.155160 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1207/2428] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:50:48.156880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:50:48.158757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:50:48.170292 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1222/2429] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:50:58.149620 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=41 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:58.165587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=9 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:00.856418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:00.856964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:00.857321 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:00.891294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:00.893405 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:00.902599 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1208/2430] 10.222.0.45 () {58 vars in 967 bytes} [Mon May 23 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:00.916519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:00.928028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790bfad-5842-40e8-a33c-d949b5fa2a01 service placement] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:00.933800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2924073-e9f6-4ca4-9b83-80cb41b989fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:00.934827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2924073-e9f6-4ca4-9b83-80cb41b989fd service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:00.935274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2924073-e9f6-4ca4-9b83-80cb41b989fd service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:00.935553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2924073-e9f6-4ca4-9b83-80cb41b989fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:00.944874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2924073-e9f6-4ca4-9b83-80cb41b989fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:00.947502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2924073-e9f6-4ca4-9b83-80cb41b989fd service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:00.957816 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1223/2431] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:51:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 12:51:02.407015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:02.408740 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:02.469365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15285fa-fdeb-45a2-a039-24449fb59b0f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:02.473433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:02.482194 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:02.482683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:02.483124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:02.485285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:02.571659 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:02.573355 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa918c-9a57-4e51-bf37-7660f95ee65c service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:02.583943 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1209/2432] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:51:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:51:06.141537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41538-6452-4106-8f46-6ccdc113b329 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:06.142076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41538-6452-4106-8f46-6ccdc113b329 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:06.142904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41538-6452-4106-8f46-6ccdc113b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:06.161364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-61f41538-6452-4106-8f46-6ccdc113b329 None None] MFA Rules not processed for user `b4f6e3f8e0f2431888f20f91fb469c72`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:06.162733 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-61f41538-6452-4106-8f46-6ccdc113b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:06.241760 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1224/2433] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:06.809339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:06.809832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:06.811857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:06.846442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] MFA Rules not processed for user `2335faffe08d4c75ab85aa124819c513`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:06.848002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:06.919775 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1210/2434] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:16.223195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=31 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:16.914463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=78 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:24.526163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab251-82ad-4bcc-b746-ebae416b6b93 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:24.526748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab251-82ad-4bcc-b746-ebae416b6b93 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:24.526748 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab251-82ad-4bcc-b746-ebae416b6b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:24.545181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-c3bab251-82ad-4bcc-b746-ebae416b6b93 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:24.546376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c3bab251-82ad-4bcc-b746-ebae416b6b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:24.554059 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1225/2435] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:24.569066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:24.582456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e594f9-ba14-4f75-8939-f67b50b17ac0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:24.588965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:24.589608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:24.590164 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:24.590477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:24.598878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:24.600465 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:24.610629 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1211/2436] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:51:27.848834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484471-d8ff-4214-9fcc-fa949626a896 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:27.849451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484471-d8ff-4214-9fcc-fa949626a896 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:27.849451 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484471-d8ff-4214-9fcc-fa949626a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:27.867992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6d484471-d8ff-4214-9fcc-fa949626a896 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:27.869217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6d484471-d8ff-4214-9fcc-fa949626a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:27.876939 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1226/2437] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:27.906015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:27.907458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:27.922707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58855add-9b14-4a23-9fdb-2f7d584255de service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:27.928623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:27.929292 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:27.929670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:27.930023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:27.938568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:27.940158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:27.950237 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1212/2438] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:51:30.857247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa60aa-6b1a-4efd-b6c8-064b2dbbe734 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:30.857758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa60aa-6b1a-4efd-b6c8-064b2dbbe734 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:30.857868 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa60aa-6b1a-4efd-b6c8-064b2dbbe734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:30.875579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-fafa60aa-6b1a-4efd-b6c8-064b2dbbe734 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:30.876775 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-fafa60aa-6b1a-4efd-b6c8-064b2dbbe734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:30.884914 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1227/2439] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:30.929191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:30.940817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd418f-6698-44de-80c3-87f68ce7c4d5 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:30.946448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:30.947080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:30.947365 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:30.947644 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:30.955798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:30.957397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:30.967593 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1213/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:51:33.995384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9908e-ce42-4b6b-95ae-4873a219ac68 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:33.995875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9908e-ce42-4b6b-95ae-4873a219ac68 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:33.995969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9908e-ce42-4b6b-95ae-4873a219ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:34.013996 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-acc9908e-ce42-4b6b-95ae-4873a219ac68 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:34.015201 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-acc9908e-ce42-4b6b-95ae-4873a219ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:34.022998 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1228/2441] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:51:34.041699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:34.052808 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5416f-e015-47a1-b5da-77c397c0be36 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:34.058444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:34.059078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:34.059357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:34.059635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:34.068856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:34.070632 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:34.080066 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1214/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:51:37.160792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24679-e5f3-4ec5-afdb-94fa149e7eb1 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:37.161262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24679-e5f3-4ec5-afdb-94fa149e7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:37.161370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24679-e5f3-4ec5-afdb-94fa149e7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:37.180180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6ec24679-e5f3-4ec5-afdb-94fa149e7eb1 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:37.182001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6ec24679-e5f3-4ec5-afdb-94fa149e7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:37.190646 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1229/2443] 10.222.0.55 () {58 vars in 1016 bytes} [Mon May 23 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:51:37.211235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:51:37.222756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1d64-9eb7-498f-9ac2-22b4ce0abdbe service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:51:37.228926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4cc76-ec2d-47ad-868d-2fcb92ebc51c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:51:37.229594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4cc76-ec2d-47ad-868d-2fcb92ebc51c service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:37.229883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4cc76-ec2d-47ad-868d-2fcb92ebc51c service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:37.230165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4cc76-ec2d-47ad-868d-2fcb92ebc51c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:37.238331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4cc76-ec2d-47ad-868d-2fcb92ebc51c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:51:37.239901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4cc76-ec2d-47ad-868d-2fcb92ebc51c service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:51:37.250101 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1215/2444] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:51:47.174898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=15 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:47.245898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=30 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:55.213434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34306b7f-e3e4-4af0-9e05-a87b8a8c574d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:51:55.214044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34306b7f-e3e4-4af0-9e05-a87b8a8c574d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:51:55.214228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34306b7f-e3e4-4af0-9e05-a87b8a8c574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:51:55.234102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-34306b7f-e3e4-4af0-9e05-a87b8a8c574d None None] MFA Rules not processed for user `d23ca857b76540ce83053424b710697b`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:51:55.235368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-34306b7f-e3e4-4af0-9e05-a87b8a8c574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:51:55.295150 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1230/2445] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:05.287402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=25 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:06.520307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3952f-ba11-49cf-bf9e-f4affb74d8e3 None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:06.520881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3952f-ba11-49cf-bf9e-f4affb74d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:06.521092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3952f-ba11-49cf-bf9e-f4affb74d8e3 None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:06.522736 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1216/2446] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:52:06.552197 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:06.553685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:06.554261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:06.610376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] MFA Rules not processed for user `0d0631d051ad40a598b227671ee2ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:06.612119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:06.622410 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1231/2447] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:52:06.634445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3952f-ba11-49cf-bf9e-f4affb74d8e3 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:06.636565 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4ae3952f-ba11-49cf-bf9e-f4affb74d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:06.655619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3952f-ba11-49cf-bf9e-f4affb74d8e3 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:06.656150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:06.660992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:06.662017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:06.662802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:06.663186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] PATH_INFO: `/v3/users/b4f6e3f8e0f2431888f20f91fb469c72` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:06.664748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f6e3f8e0f2431888f20f91fb469c72)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:06.668049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:06.669804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064adcb-9ea2-4ae2-a139-2a1da728f9d0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:06.675577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:06.676633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:06.677545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:06.678004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:06.688705 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:06.698087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:06.728826 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1232/2448] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:52:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:52:06.739445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f6e3f8e0f2431888f20f91fb469c72'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:06.747594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f6e3f8e0f2431888f20f91fb469c72'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:06.748320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f6e3f8e0f2431888f20f91fb469c72'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:06.767891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f6e3f8e0f2431888f20f91fb469c72'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:06.783105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ea62f5f-31a7-499e-b74e-5c3fe5e79932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f6e3f8e0f2431888f20f91fb469c72'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:06.791061 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1217/2449] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:52:06 2022] DELETE /identity/v3/users/b4f6e3f8e0f2431888f20f91fb469c72 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:52:06.999573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.040345 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c017f92-d66d-40a8-ac81-04b9bdacaccd service placement] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.137780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.139030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.139492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.140083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] PATH_INFO: `/v3/projects/138b75f9014a4698b462d0c7483b9420` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.141512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138b75f9014a4698b462d0c7483b9420)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.143804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.201230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138b75f9014a4698b462d0c7483b9420', 'request_id': 'req-97cf372b-e756-4a26-9a52-da17c3a22441'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:07.209534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138b75f9014a4698b462d0c7483b9420', 'request_id': 'req-97cf372b-e756-4a26-9a52-da17c3a22441'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:07.221832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138b75f9014a4698b462d0c7483b9420', 'request_id': 'req-97cf372b-e756-4a26-9a52-da17c3a22441'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:07.243159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] The token cache is being invalidate because project 138b75f9014a4698b462d0c7483b9420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:52:07.243338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:07.244226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-97cf372b-e756-4a26-9a52-da17c3a22441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:07.246344 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1233/2450] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:52:06 2022] DELETE /identity/v3/projects/138b75f9014a4698b462d0c7483b9420 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:07.252136 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.252574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.253041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.272527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:07.274022 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:07.339432 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1218/2451] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:07.346901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.347193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.347481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.366944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:07.368375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:07.376837 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1234/2452] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:07.380993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.392286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad7b41-7ffe-4a66-904e-1652a210d106 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.396918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.397735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.398688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.399160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.400079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:52:07.400390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.402043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.415919 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1219/2453] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:52:07.420504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.431470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040842e-4a70-4253-add5-f5ede58f75a4 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.436148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.436823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.437099 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.437403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.438088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.439999 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.472316 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1235/2454] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:52:07 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:52:07.473598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.484057 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e81fd5-207c-4c80-93c5-e36a74858f1c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.546601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.547425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.547606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.547890 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.548583 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.550546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.558222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:07.575111 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1220/2455] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:52:07 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:52:07.578776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.590430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcc22-f96e-425f-9fab-c5dac7ca0462 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.595780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.595925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.596212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.596486 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.597283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.599138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.613629 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1236/2456] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:52:07.614775 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.625652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e00f-6856-4eeb-9635-fae57951a323 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.630323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e3fc9-befd-424e-9597-7a300d21561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.630983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3fc9-befd-424e-9597-7a300d21561d admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.631273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3fc9-befd-424e-9597-7a300d21561d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.631554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3fc9-befd-424e-9597-7a300d21561d admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.632948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e3fc9-befd-424e-9597-7a300d21561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.634745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e3fc9-befd-424e-9597-7a300d21561d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.649008 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1221/2457] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:52:07.650371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.662059 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a468-e199-4c42-88e7-11af6c8fe3b7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.667365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.668243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.668525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.668919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] PATH_INFO: `/v3/projects/415f580f095643cdafc2a7b90927ab65/users/277722f7bbc940bc8f98defc56c2c872/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.683955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] RBAC: Authorizing `identity:create_grant(project_id=415f580f095643cdafc2a7b90927ab65, user_id=277722f7bbc940bc8f98defc56c2c872, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.686779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.689075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:07.701628 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1237/2458] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:52:07 2022] PUT /identity/v3/projects/415f580f095643cdafc2a7b90927ab65/users/277722f7bbc940bc8f98defc56c2c872/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:07.712453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.712831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.713211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.743709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] MFA Rules not processed for user `277722f7bbc940bc8f98defc56c2c872`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:07.745048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:07.816304 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1222/2459] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:07.828825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:07.831026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:07.920484 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b449d-f280-45cf-87da-bec4de4a08be admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:07.924554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c1977-a41e-4a89-afa2-932604b13b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:07.925230 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1977-a41e-4a89-afa2-932604b13b65 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:07.925508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1977-a41e-4a89-afa2-932604b13b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:07.925783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1977-a41e-4a89-afa2-932604b13b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:07.935264 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1977-a41e-4a89-afa2-932604b13b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:07.936715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1977-a41e-4a89-afa2-932604b13b65 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:07.946790 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1238/2460] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:52:12.945954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:13.020406 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7bd56-efe9-4562-b56b-9581f0818248 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:13.028369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:13.029431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:13.029680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:13.029961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] PATH_INFO: `/v3/users/277722f7bbc940bc8f98defc56c2c872` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:13.033617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] RBAC: Authorizing `identity:delete_user(user_id=277722f7bbc940bc8f98defc56c2c872)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:13.036457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:13.097990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277722f7bbc940bc8f98defc56c2c872'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.105821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277722f7bbc940bc8f98defc56c2c872'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.106584 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277722f7bbc940bc8f98defc56c2c872'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.117541 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:13.122208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277722f7bbc940bc8f98defc56c2c872'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.130779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277722f7bbc940bc8f98defc56c2c872'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.137720 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1223/2461] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:52:12 2022] DELETE /identity/v3/users/277722f7bbc940bc8f98defc56c2c872 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:13.142385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:13.142838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:13.142977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:13.160949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:13.162224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:13.224106 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1239/2462] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:13.234033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:13.235455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:13.291637 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56f27-99b6-4b61-b76f-a224fe43632e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:13.295246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e47dce-f5fc-41eb-b710-3523472a9df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:13.295885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47dce-f5fc-41eb-b710-3523472a9df8 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:13.296163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47dce-f5fc-41eb-b710-3523472a9df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:13.296436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47dce-f5fc-41eb-b710-3523472a9df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:13.305861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e47dce-f5fc-41eb-b710-3523472a9df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:13.307303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e47dce-f5fc-41eb-b710-3523472a9df8 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:13.316673 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1224/2463] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:52:13.583790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:13.586170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:13.602851 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4d337-ac75-4711-be4a-4a8e800d53a2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:13.613975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:13.614850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:13.615190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:13.615502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] PATH_INFO: `/v3/projects/415f580f095643cdafc2a7b90927ab65` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:13.616860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415f580f095643cdafc2a7b90927ab65)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:13.618885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:13.667518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415f580f095643cdafc2a7b90927ab65', 'request_id': 'req-7953aff3-f283-48b9-a498-a798e546ad80'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.673393 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415f580f095643cdafc2a7b90927ab65', 'request_id': 'req-7953aff3-f283-48b9-a498-a798e546ad80'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.679645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415f580f095643cdafc2a7b90927ab65', 'request_id': 'req-7953aff3-f283-48b9-a498-a798e546ad80'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.689049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:13.693633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] The token cache is being invalidate because project 415f580f095643cdafc2a7b90927ab65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:52:13.694130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.695369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-7953aff3-f283-48b9-a498-a798e546ad80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:13.697052 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1240/2464] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:52:13 2022] DELETE /identity/v3/projects/415f580f095643cdafc2a7b90927ab65 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:18.931801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24666588-d1e3-483e-95ec-d1d6284bc0ca None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:18.932290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24666588-d1e3-483e-95ec-d1d6284bc0ca None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:18.932458 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24666588-d1e3-483e-95ec-d1d6284bc0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:18.950653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-24666588-d1e3-483e-95ec-d1d6284bc0ca None None] MFA Rules not processed for user `2335faffe08d4c75ab85aa124819c513`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:18.951994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-24666588-d1e3-483e-95ec-d1d6284bc0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:19.011520 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1225/2465] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:21.450198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:21.450730 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:21.450730 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:21.470436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] MFA Rules not processed for user `e90f349f384245fb8a118be176ad6829`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:21.471662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:21.528322 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1241/2466] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:29.003585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=2,keystone:SELECT=54,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:31.520624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=25 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:40.533085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:40.533536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:40.533672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:40.551375 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:52:40.552552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:40.607874 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1226/2467] 10.222.0.45 () {58 vars in 967 bytes} [Mon May 23 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:52:40.653869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:40.655275 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:40.723984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887ac8c-fb4e-43c8-9bcb-e50521a3e3a2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:40.730082 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:40.730743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:40.731021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:40.731289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:40.739582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:40.741783 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:40.749798 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1242/2468] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:52:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:52:47.460829 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:47.462361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:47.529865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c665a-fcc3-4aec-b92d-4a434b775abd None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:47.534304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:47.535173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:47.535456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:47.535735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] PATH_INFO: `/v3/users/29b73578628342a6a5751a6cb6cb7a7e` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:47.537074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b73578628342a6a5751a6cb6cb7a7e)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:47.539128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:47.584683 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b73578628342a6a5751a6cb6cb7a7e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.591850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b73578628342a6a5751a6cb6cb7a7e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.592506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b73578628342a6a5751a6cb6cb7a7e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.604608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b73578628342a6a5751a6cb6cb7a7e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.611889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b73578628342a6a5751a6cb6cb7a7e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.618557 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1227/2469] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:52:47 2022] DELETE /identity/v3/users/29b73578628342a6a5751a6cb6cb7a7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:47.790813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:47.803815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9d8a-fd5e-43a2-b4ff-e38e07eee861 service swift] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:47.862350 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:47.863207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:47.863488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:47.863764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] PATH_INFO: `/v3/projects/a0ef120b9d274ff4b3db10ea968e99d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:47.864925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ef120b9d274ff4b3db10ea968e99d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:47.867438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:47.913713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ef120b9d274ff4b3db10ea968e99d1', 'request_id': 'req-73a62b6e-5b45-4854-bedf-c2b53754c557'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.919158 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ef120b9d274ff4b3db10ea968e99d1', 'request_id': 'req-73a62b6e-5b45-4854-bedf-c2b53754c557'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.925215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ef120b9d274ff4b3db10ea968e99d1', 'request_id': 'req-73a62b6e-5b45-4854-bedf-c2b53754c557'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.938194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] The token cache is being invalidate because project a0ef120b9d274ff4b3db10ea968e99d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:52:47.938480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.939090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:47.940738 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1243/2470] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:52:47 2022] DELETE /identity/v3/projects/a0ef120b9d274ff4b3db10ea968e99d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:47.944842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:47.946263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:47.959556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2a13-3192-44e5-a684-efc45f5aa534 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:47.979654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:48.017098 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:48.017990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:48.018272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:48.018552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] PATH_INFO: `/v3/users/344d82e4d05443ba9d0248928d883a2e` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:48.019720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=344d82e4d05443ba9d0248928d883a2e)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:48.022398 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:48.069159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344d82e4d05443ba9d0248928d883a2e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.076314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344d82e4d05443ba9d0248928d883a2e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.077003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344d82e4d05443ba9d0248928d883a2e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.091444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344d82e4d05443ba9d0248928d883a2e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.098949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344d82e4d05443ba9d0248928d883a2e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.105825 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1228/2471] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:52:47 2022] DELETE /identity/v3/users/344d82e4d05443ba9d0248928d883a2e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:48.278198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:52:48.279663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:52:48.293253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62b6e-5b45-4854-bedf-c2b53754c557 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:52:48.310455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:48.357130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:52:48.358008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:52:48.358286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:52:48.358556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] PATH_INFO: `/v3/projects/c27477c55ec540fb9870e4737abe9320` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:52:48.359714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27477c55ec540fb9870e4737abe9320)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:52:48.361660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:52:48.408429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27477c55ec540fb9870e4737abe9320', 'request_id': 'req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.413910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27477c55ec540fb9870e4737abe9320', 'request_id': 'req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.419884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27477c55ec540fb9870e4737abe9320', 'request_id': 'req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.432337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] The token cache is being invalidate because project c27477c55ec540fb9870e4737abe9320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:52:48.432629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.433300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:52:48.434930 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1244/2472] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:52:48 2022] DELETE /identity/v3/projects/c27477c55ec540fb9870e4737abe9320 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:52:58.102125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:58.429101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:00.426082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:00.427479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:00.487504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377578-afa2-4a1d-9f37-8afd58faae5f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:00.534655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:00.535303 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:00.535592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:00.535875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:00.538277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:00.607396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:00.608766 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:00.620291 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1229/2473] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:03.253945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:03.255438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:03.312916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5c42-3ec3-4ba0-ae97-fdaa1f2126c4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:03.316455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:03.317085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:03.317391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:03.317665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:03.320294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:03.333835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:03.335283 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:03.346667 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1245/2474] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:06.312179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:06.314657 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:06.337079 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08eceb-ebfc-48c2-b047-2273ced6ea73 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:06.345089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:06.345819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:06.346180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:06.346477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:06.348557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:06.363475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:06.365812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:06.377734 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1230/2475] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:09.121409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:09.122941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:09.137528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7ab5-5214-4ec6-bb67-8c5e3af6b611 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:09.143049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:09.143682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:09.143965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:09.144245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:09.145991 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:09.204357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:09.206127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:09.219621 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1246/2476] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:12.927056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:12.939568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94083e-54dd-4841-87a4-3dbb27ee0a00 service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:12.945350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:12.946742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:12.947031 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:12.947324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:12.949185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:12.996007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:13.013205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:13.014826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:13.025315 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1231/2477] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:19.213325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=54 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:21.963305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:21.965036 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:22.056062 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:22.057629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:22.137288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb701-a6ce-4047-970a-1dc841279851 service nova] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:22.155678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:22.156349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.156632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.156910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.159356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:22.180415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:22.182861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:22.194882 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1247/2478] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:22.196854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da98a2-ddbe-4ebf-b29f-6759932d18db service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:22.201514 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:22.202397 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.202701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.202998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] PATH_INFO: `/v3/users/e90f349f384245fb8a118be176ad6829` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.204222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90f349f384245fb8a118be176ad6829)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:22.206241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:22.278317 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90f349f384245fb8a118be176ad6829'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.288730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90f349f384245fb8a118be176ad6829'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.291188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90f349f384245fb8a118be176ad6829'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.312468 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90f349f384245fb8a118be176ad6829'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.326546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4f9f1b87-c88a-411d-8c17-5ef0ee820b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90f349f384245fb8a118be176ad6829'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.355021 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1232/2479] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:22 2022] DELETE /identity/v3/users/e90f349f384245fb8a118be176ad6829 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:53:22.572480 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:22.583883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2efc4-045b-4c1f-a375-cb53ece09cb5 service placement] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:22.646559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:22.647545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.648929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.648929 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] PATH_INFO: `/v3/projects/3433fceb10214afcbc819edcec864651` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.650759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3433fceb10214afcbc819edcec864651)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:22.652757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:22.705840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3433fceb10214afcbc819edcec864651', 'request_id': 'req-f709caab-bd00-475e-ae26-6ca57765e16f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.712813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3433fceb10214afcbc819edcec864651', 'request_id': 'req-f709caab-bd00-475e-ae26-6ca57765e16f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.719586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3433fceb10214afcbc819edcec864651', 'request_id': 'req-f709caab-bd00-475e-ae26-6ca57765e16f'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.733582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] The token cache is being invalidate because project 3433fceb10214afcbc819edcec864651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:22.733752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.734448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f709caab-bd00-475e-ae26-6ca57765e16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:22.736045 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1248/2480] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:22 2022] DELETE /identity/v3/projects/3433fceb10214afcbc819edcec864651 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:22.741015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.741325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.741607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.761625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:22.762985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:22.826334 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1233/2481] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:22.833941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.834188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.834476 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.857481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:22.858727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:22.877517 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1249/2482] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:22.880589 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:22.886260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:22.892140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f908-73c5-439a-8af1-8f4eabd8df9e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:22.911172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:22.911862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.912169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.912424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.913209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:53:22.913497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:22.915334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:22.928186 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1234/2483] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:53:22.932250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:22.948080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324d553-d5d2-4adf-ad81-66e49d533036 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:22.953110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:22.953864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:22.954145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:22.954418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:22.955115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:22.957030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:22.970073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:22.995418 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1250/2484] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:22 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:22.996624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:23.007102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483bcfe-9112-417e-a386-8fd24d7af639 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:23.090159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:23.090819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:23.091191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:23.091538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:23.093228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:23.095182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:23.121190 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1235/2485] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:22 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:23.124914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:23.135510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580e66-fef1-4fe9-9807-da460230c480 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:23.140522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:23.141462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:23.141751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:23.142034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:23.142764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:23.144427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:23.155863 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1251/2486] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:23.159909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:23.170818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42599f6-8a37-4305-a835-6db443b28777 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:23.176078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ecfe1-cb05-4ba7-b2b5-bf937943e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:23.176743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ecfe1-cb05-4ba7-b2b5-bf937943e88a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:23.177025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ecfe1-cb05-4ba7-b2b5-bf937943e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:23.177331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ecfe1-cb05-4ba7-b2b5-bf937943e88a admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:23.178052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ecfe1-cb05-4ba7-b2b5-bf937943e88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:23.179887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ecfe1-cb05-4ba7-b2b5-bf937943e88a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:23.193732 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1236/2487] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:23.194997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:23.206465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5633853-6adf-4a97-af73-a82679cd45fc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:23.213061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:23.214070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:23.214430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:23.214766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] PATH_INFO: `/v3/projects/18e2757f7e6644099af9e5510954a391/users/d96f7e82915f4563b05c20c414c23229/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:23.234234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e2757f7e6644099af9e5510954a391, user_id=d96f7e82915f4563b05c20c414c23229, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:23.237021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:23.252097 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1252/2488] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:23 2022] PUT /identity/v3/projects/18e2757f7e6644099af9e5510954a391/users/d96f7e82915f4563b05c20c414c23229/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:23.257277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edfcb6-17fa-4c01-830a-602b1016eabe None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:23.257574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edfcb6-17fa-4c01-830a-602b1016eabe None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:23.258441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edfcb6-17fa-4c01-830a-602b1016eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:23.278109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-14edfcb6-17fa-4c01-830a-602b1016eabe None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:23.279674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-14edfcb6-17fa-4c01-830a-602b1016eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:23.348140 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1237/2489] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:23.358084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:23.359933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:23.421182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c03cc1-d17d-4189-9ef8-5c28b725c4b2 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:23.424933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:23.425608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:23.425886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:23.426159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:23.436825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:23.438274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:23.449515 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1253/2490] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:27.666498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f0569-2a6d-49f2-bb88-93a5344d5216 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:27.666982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f0569-2a6d-49f2-bb88-93a5344d5216 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:27.667179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f0569-2a6d-49f2-bb88-93a5344d5216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:27.704112 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8a0f0569-2a6d-49f2-bb88-93a5344d5216 None None] MFA Rules not processed for user `d96f7e82915f4563b05c20c414c23229`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:27.705470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8a0f0569-2a6d-49f2-bb88-93a5344d5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:27.741204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:27.742796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:27.755505 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708f2bb-6220-4156-b503-0f24a932fdb2 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:27.759378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:27.760032 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:27.760315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:27.760593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:27.766296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:27.782077 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:27.783837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:27.796971 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1254/2491] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:53:27.805600 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1238/2492] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:27.806414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:27.819076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:27.821939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:27.906432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d86db0-022f-4a40-b332-53388b17acb2 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:27.912295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:27.912960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:27.913269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:27.913558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:27.923426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:27.925069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:27.936087 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1255/2493] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:29.549173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:29.549694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:29.549801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:29.572248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] MFA Rules not processed for user `d96f7e82915f4563b05c20c414c23229`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:29.573561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:29.581398 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1239/2494] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:29.977171 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:29.993767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f3f4-f296-43a5-9abf-f5ed191721fb service nova] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:29.998666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:29.999375 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:29.999603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:30.000073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:30.002478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:30.015122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:30.016581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:30.026447 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1256/2495] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:30.477603 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:30.479721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:30.593384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d42fd-4acb-44b9-ac02-5b96858a0372 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:30.599320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:30.600178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:30.600631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:30.601652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:30.603689 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:30.618501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:30.622708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:30.645463 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1240/2496] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:32.463816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:32.465579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:32.486219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2378a1d-166f-45fb-8faa-3e8b5bb5741b service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:32.493889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:32.494817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:32.495538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:32.495834 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] PATH_INFO: `/v3/users/2335faffe08d4c75ab85aa124819c513` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:32.497105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2335faffe08d4c75ab85aa124819c513)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:32.499117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:32.514369 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:32.560654 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2335faffe08d4c75ab85aa124819c513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:32.568404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2335faffe08d4c75ab85aa124819c513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:32.569436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2335faffe08d4c75ab85aa124819c513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:32.582488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2335faffe08d4c75ab85aa124819c513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:32.583181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32a0f899-451f-4f45-a5b2-c567c7671f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2335faffe08d4c75ab85aa124819c513'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:32.608167 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1257/2497] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:32 2022] DELETE /identity/v3/users/2335faffe08d4c75ab85aa124819c513 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:32.799812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:32.848212 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f874c5c-eafd-48dc-b278-580ef9c1d626 service placement] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:32.934353 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:32.935294 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:32.935578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:32.935859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] PATH_INFO: `/v3/projects/779c7b393d37486eadf1fdc94edf7e59` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:32.937293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] RBAC: Authorizing `identity:delete_project(project_id=779c7b393d37486eadf1fdc94edf7e59)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:32.939291 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:32.996020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779c7b393d37486eadf1fdc94edf7e59', 'request_id': 'req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:33.005749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779c7b393d37486eadf1fdc94edf7e59', 'request_id': 'req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:33.012926 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779c7b393d37486eadf1fdc94edf7e59', 'request_id': 'req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:33.030643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] The token cache is being invalidate because project 779c7b393d37486eadf1fdc94edf7e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:33.032216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:33.032888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:33.034543 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1241/2498] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:32 2022] DELETE /identity/v3/projects/779c7b393d37486eadf1fdc94edf7e59 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:33.040310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20a9c-4c84-4c85-8e1b-6ee0374c6365 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.041278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20a9c-4c84-4c85-8e1b-6ee0374c6365 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.041760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20a9c-4c84-4c85-8e1b-6ee0374c6365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.062773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-aac20a9c-4c84-4c85-8e1b-6ee0374c6365 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:33.063968 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-aac20a9c-4c84-4c85-8e1b-6ee0374c6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:33.067266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.071718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:33.111384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:33.147203 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1258/2499] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:33.155754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276dcb3-ea79-409d-8b61-eb5b3c92ceca admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.156462 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.156822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.157257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.159520 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.160198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.160477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.160752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.162519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:33.173055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.174512 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.176716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:33.178029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:33.183272 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1242/2500] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:53:33.186437 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1259/2501] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:53:33.190498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.202615 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4ca7-6672-4cb4-ac48-dc14c33e4d2d service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.208579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.209125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.209473 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.209721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.210964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:53:33.211268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.213172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.234581 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1243/2502] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:53:33.235765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.249320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f6f35-3fb4-4ca9-90bd-a99ec820266c None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.255628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.256303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.256988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.256988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.259634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.260849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.291314 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1260/2503] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:33 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:33.296293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.308262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788833-31d8-4215-8c55-13754846e398 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.390374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.391198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.391563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.391873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.392535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.395513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.426758 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1244/2504] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:33 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:33.431018 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.442573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ab82-d0c6-44fe-bec8-7df324f280f6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.448240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.449507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.450044 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.450482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.451313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.453088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.467055 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1261/2505] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:33.470457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.482499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716aaa5-50dd-40ae-a876-312951fff534 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.488244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652c4c-f88a-4074-8756-16f9628be1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.488920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652c4c-f88a-4074-8756-16f9628be1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.489239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652c4c-f88a-4074-8756-16f9628be1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.489522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652c4c-f88a-4074-8756-16f9628be1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.490651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c652c4c-f88a-4074-8756-16f9628be1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.492847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c652c4c-f88a-4074-8756-16f9628be1d2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.508088 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1245/2506] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:33.513029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.524315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b367f54-a4ae-4756-a905-0d37006b4a00 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.529923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.530870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.531315 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.531743 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] PATH_INFO: `/v3/projects/9450793b3dc54f8b86c2ccf6f6b6360f/users/49bcd4d0cd284d74a5783381571e6e23/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.549902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9450793b3dc54f8b86c2ccf6f6b6360f, user_id=49bcd4d0cd284d74a5783381571e6e23, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.552622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.569543 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1262/2507] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:33 2022] PUT /identity/v3/projects/9450793b3dc54f8b86c2ccf6f6b6360f/users/49bcd4d0cd284d74a5783381571e6e23/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:33.579704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.580106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.580431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.609096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] MFA Rules not processed for user `49bcd4d0cd284d74a5783381571e6e23`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:33.610522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:33.686499 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1246/2508] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:33.693338 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:33.695432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:33.733624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:33.785348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352604c-bb74-45e0-99ba-868e0524c3aa admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:33.792392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af47e-a7bf-46e5-bd89-fe015da85473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:33.793224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af47e-a7bf-46e5-bd89-fe015da85473 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:33.793637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af47e-a7bf-46e5-bd89-fe015da85473 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:33.794535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af47e-a7bf-46e5-bd89-fe015da85473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:33.805112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51af47e-a7bf-46e5-bd89-fe015da85473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:33.806524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51af47e-a7bf-46e5-bd89-fe015da85473 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:33.817478 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1263/2509] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:36.643336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:36.652056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:36.708884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0805e-fb67-4a6e-a162-c1ba5828556d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:36.714771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:36.715684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:36.715971 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:36.716249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] PATH_INFO: `/v3/users/49bcd4d0cd284d74a5783381571e6e23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:36.717535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bcd4d0cd284d74a5783381571e6e23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:36.719650 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:36.768638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bcd4d0cd284d74a5783381571e6e23'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:36.776617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bcd4d0cd284d74a5783381571e6e23'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:36.777381 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bcd4d0cd284d74a5783381571e6e23'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:36.790670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bcd4d0cd284d74a5783381571e6e23'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:36.799996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bcd4d0cd284d74a5783381571e6e23'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:36.806393 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1247/2510] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:36 2022] DELETE /identity/v3/users/49bcd4d0cd284d74a5783381571e6e23 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:36.810971 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:36.811454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:36.811549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:36.828523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:36.829925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:36.890072 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1264/2511] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:36.900247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:36.901736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:36.961870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694da17-5600-4189-8601-5005267407b2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:36.965825 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baae354-7f23-4699-8d05-cd3d0996c549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:36.966470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baae354-7f23-4699-8d05-cd3d0996c549 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:36.966756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baae354-7f23-4699-8d05-cd3d0996c549 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:36.967036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baae354-7f23-4699-8d05-cd3d0996c549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:36.976763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baae354-7f23-4699-8d05-cd3d0996c549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:36.978213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baae354-7f23-4699-8d05-cd3d0996c549 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:36.987595 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1248/2512] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:37.261791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.263323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:37.276149 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66920-c371-4536-b994-f9be004d0992 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.280735 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.281620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.281904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.282186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] PATH_INFO: `/v3/projects/9450793b3dc54f8b86c2ccf6f6b6360f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.283365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9450793b3dc54f8b86c2ccf6f6b6360f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.285330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.336779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9450793b3dc54f8b86c2ccf6f6b6360f', 'request_id': 'req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:37.342525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9450793b3dc54f8b86c2ccf6f6b6360f', 'request_id': 'req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:37.348831 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9450793b3dc54f8b86c2ccf6f6b6360f', 'request_id': 'req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:37.362535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] The token cache is being invalidate because project 9450793b3dc54f8b86c2ccf6f6b6360f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:37.362824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:37.363445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4be2f9ae-8f8b-4d95-b15b-02f2b309cc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:37.365014 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1265/2513] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:37 2022] DELETE /identity/v3/projects/9450793b3dc54f8b86c2ccf6f6b6360f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:53:37.370649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.370939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.371246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.389500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:37.390776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:37.417955 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:37.453685 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1249/2514] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:37.461458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.461747 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.462286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.480143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:37.481452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:37.489346 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1266/2515] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:37.494253 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.504352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9e47-7833-406b-8880-fdfe7c6e002b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.509869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.510608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.510962 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.511309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.512116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:53:37.512493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.514244 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.530260 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1250/2516] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:53:37.531420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.541435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629b8c-9d98-4835-8b2b-3e7daa7441a0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.546134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.546815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.547095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.547373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.548273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.550308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.582679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:37.595237 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1267/2517] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:37 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:53:37.596699 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.608213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d515b9-eacd-4b77-948b-9b28bd7af264 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.683667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.684528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.684918 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.685792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.686506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.688716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.717020 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1251/2518] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:37 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:53:37.720939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.733063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02096d-7037-4d36-9647-368a43baf131 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.738256 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.739142 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.739618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.740025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.740852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.743424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.754567 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1268/2519] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:37.759257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.770688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396396b-c076-465c-a542-1027860c2c4e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.776332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988105f-0702-4404-b139-1e2b0f0f0c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.776886 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988105f-0702-4404-b139-1e2b0f0f0c68 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.777545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988105f-0702-4404-b139-1e2b0f0f0c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.777545 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988105f-0702-4404-b139-1e2b0f0f0c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.778326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988105f-0702-4404-b139-1e2b0f0f0c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.779819 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988105f-0702-4404-b139-1e2b0f0f0c68 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.791409 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1252/2520] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:53:37.795977 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:37.808937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be758-104c-48d6-b57c-2afdc4482d57 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:37.814866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:37.815883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.816226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.816562 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] PATH_INFO: `/v3/projects/541cf3b2f196430cbaaf74acd9be2429/users/8f5802ef571e46e798af6ec1f0e053bb/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.833215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] RBAC: Authorizing `identity:create_grant(project_id=541cf3b2f196430cbaaf74acd9be2429, user_id=8f5802ef571e46e798af6ec1f0e053bb, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:37.837539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:37.851938 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1269/2521] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:37 2022] PUT /identity/v3/projects/541cf3b2f196430cbaaf74acd9be2429/users/8f5802ef571e46e798af6ec1f0e053bb/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:37.863440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:37.863737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:37.864023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:37.892250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] MFA Rules not processed for user `8f5802ef571e46e798af6ec1f0e053bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:37.893677 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:37.966020 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1253/2522] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:37.971364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.049112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716eebd-43a4-4f95-b5b3-57648cd6638d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.055341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.056138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.056566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.056846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.057636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.059606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.090879 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1270/2523] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:37 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:38.096719 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.112857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd123c9-8c96-40de-b8e8-bb51987cf9a7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.144455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:38.180450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.181648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.181927 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.182200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.182929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.184872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.209855 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1254/2524] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:38 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:38.212325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.223884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c849-53f3-46de-ae11-58ced4da2300 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.229751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.230413 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.230691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.230962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.231678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.233309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.244765 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1271/2525] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:38.253180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.263202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566d264-91ca-4908-a589-7e7fa0f6b92f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.267751 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.268623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.268903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.269206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] PATH_INFO: `/v3/projects/48d7058d8fce454e90696a0db566f7c6/users/29a6a5c1cc864404ae71f9826553bc17/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.284106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d7058d8fce454e90696a0db566f7c6, user_id=29a6a5c1cc864404ae71f9826553bc17, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.286805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.300907 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1255/2526] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:38 2022] PUT /identity/v3/projects/48d7058d8fce454e90696a0db566f7c6/users/29a6a5c1cc864404ae71f9826553bc17/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:38.305193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.315329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e379-d2a8-490f-9df7-f8d425fedc55 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.376611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5477c-7c0b-46a5-abe2-b3c63326afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.377314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5477c-7c0b-46a5-abe2-b3c63326afdf admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.377600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5477c-7c0b-46a5-abe2-b3c63326afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.377879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5477c-7c0b-46a5-abe2-b3c63326afdf admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.378599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5477c-7c0b-46a5-abe2-b3c63326afdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.380212 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5477c-7c0b-46a5-abe2-b3c63326afdf admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.390153 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1272/2527] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:38.394622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.405690 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e41a2-b5b7-4bac-aa41-9dec65d2bf0d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.410313 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.411190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.411477 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.411758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] PATH_INFO: `/v3/projects/48d7058d8fce454e90696a0db566f7c6/users/29a6a5c1cc864404ae71f9826553bc17/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.414335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d7058d8fce454e90696a0db566f7c6, user_id=29a6a5c1cc864404ae71f9826553bc17, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.417009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.427132 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1256/2528] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:38 2022] PUT /identity/v3/projects/48d7058d8fce454e90696a0db566f7c6/users/29a6a5c1cc864404ae71f9826553bc17/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:38.437177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.437482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.437765 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.464096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] MFA Rules not processed for user `29a6a5c1cc864404ae71f9826553bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:38.465330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:38.485605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:38.535022 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1273/2529] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:38.546674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:38.548386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:38.605342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5efa06-56fa-46bd-b069-aab5a1780ef8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:38.608991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b620a0-2f54-48ef-8b1a-f057e5c0393a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:38.609663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b620a0-2f54-48ef-8b1a-f057e5c0393a service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:38.609946 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b620a0-2f54-48ef-8b1a-f057e5c0393a service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:38.610224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b620a0-2f54-48ef-8b1a-f057e5c0393a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:38.669836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b620a0-2f54-48ef-8b1a-f057e5c0393a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:38.671281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b620a0-2f54-48ef-8b1a-f057e5c0393a service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:38.680434 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1257/2530] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:39.736514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:39.738435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:39.790756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:39.791306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:39.791393 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:39.812612 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:39.813853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:39.845528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbfe87-6178-44e6-8a2b-21367959ebc0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:39.847192 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:39.854829 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:39.855642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:39.855997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:39.856353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:39.858311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:39.873755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:39.875629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:39.876989 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1258/2531] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:53:39.888750 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1274/2532] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:39.910899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:39.912916 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:40.012602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2eed-6c5f-4d69-bd76-3d664f706535 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:40.017995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:40.018663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:40.018967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:40.019325 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:40.029377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:40.031055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:40.041828 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1259/2533] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:53:40.083154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:40.084956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:40.105664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09076d-f3af-4ad4-b545-e7dab49e053b service nova] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:40.119166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:40.119838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:40.120118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:40.120388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:40.135767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:40.137288 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:40.161773 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1275/2534] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:43.985425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:43.987651 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:44.011501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc701c-dc5d-49eb-9a6c-66b3b6c28ef6 service swift] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:44.024590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:44.025480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:44.025865 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:44.026708 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:44.028219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:44.043311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:44.045091 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4af0a3-b84e-40f6-a42a-1f3cf1e1a979 service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:44.057835 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1260/2535] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:44.430335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:44.536473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7418-c48d-441b-801b-367fe28e8cc7 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:44.542026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:44.553372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:44.553372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:44.553372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] PATH_INFO: `/v3/users/8f5802ef571e46e798af6ec1f0e053bb` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:44.553372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5802ef571e46e798af6ec1f0e053bb)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:44.553372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:44.625351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:44.653919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5802ef571e46e798af6ec1f0e053bb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:44.661169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5802ef571e46e798af6ec1f0e053bb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:44.662110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5802ef571e46e798af6ec1f0e053bb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:44.681050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5802ef571e46e798af6ec1f0e053bb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:44.682295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5802ef571e46e798af6ec1f0e053bb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:44.722651 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1276/2536] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:44 2022] DELETE /identity/v3/users/8f5802ef571e46e798af6ec1f0e053bb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:53:44.727421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:44.727958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:44.728377 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:44.751035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:44.752404 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:44.844373 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1261/2537] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:53:44.853890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:44.855438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:44.955397 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff225d-23fe-4298-8317-080f3f14819e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:44.959481 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:44.961664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:44.962277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:44.962660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:44.983479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:44.985437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:44.999299 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1277/2538] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:45.332899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:45.334505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:45.368523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950c11c-c4b9-49ed-9750-e61a0d891d3a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:45.374464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:45.375350 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:45.375638 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:45.375923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] PATH_INFO: `/v3/projects/541cf3b2f196430cbaaf74acd9be2429` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:45.377166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541cf3b2f196430cbaaf74acd9be2429)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:45.379262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:45.444662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541cf3b2f196430cbaaf74acd9be2429', 'request_id': 'req-d8ef546e-7cd5-4232-9298-d45388bec3f4'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.447203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:45.452248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541cf3b2f196430cbaaf74acd9be2429', 'request_id': 'req-d8ef546e-7cd5-4232-9298-d45388bec3f4'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.460210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541cf3b2f196430cbaaf74acd9be2429', 'request_id': 'req-d8ef546e-7cd5-4232-9298-d45388bec3f4'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.482565 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] The token cache is being invalidate because project 541cf3b2f196430cbaaf74acd9be2429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:45.483250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.483995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.485977 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1262/2539] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:45 2022] DELETE /identity/v3/projects/541cf3b2f196430cbaaf74acd9be2429 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:45.489881 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:45.513686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db2169-b4f0-492a-96be-b3895b5e8573 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:45.627931 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:45.630209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:45.630209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:45.630209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] PATH_INFO: `/v3/users/29a6a5c1cc864404ae71f9826553bc17` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:45.632001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a6a5c1cc864404ae71f9826553bc17)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:45.634008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:45.700807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a6a5c1cc864404ae71f9826553bc17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.708183 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:45.711066 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a6a5c1cc864404ae71f9826553bc17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.712329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a6a5c1cc864404ae71f9826553bc17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.726572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a6a5c1cc864404ae71f9826553bc17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.727636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-32773f5f-49fa-4ec2-b563-a8e8c7b7b972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a6a5c1cc864404ae71f9826553bc17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:45.757234 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1278/2540] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:45 2022] DELETE /identity/v3/users/29a6a5c1cc864404ae71f9826553bc17 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:46.090758 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.092323 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:46.133943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef546e-7cd5-4232-9298-d45388bec3f4 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.214481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.215653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.215934 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.216251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] PATH_INFO: `/v3/projects/48d7058d8fce454e90696a0db566f7c6` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.217682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d7058d8fce454e90696a0db566f7c6)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.219590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.275279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d7058d8fce454e90696a0db566f7c6', 'request_id': 'req-99b507b4-2b03-495f-8b88-ebf591e6edec'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:46.282507 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d7058d8fce454e90696a0db566f7c6', 'request_id': 'req-99b507b4-2b03-495f-8b88-ebf591e6edec'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:46.289047 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d7058d8fce454e90696a0db566f7c6', 'request_id': 'req-99b507b4-2b03-495f-8b88-ebf591e6edec'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:46.303271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] The token cache is being invalidate because project 48d7058d8fce454e90696a0db566f7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:46.303915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:46.304912 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99b507b4-2b03-495f-8b88-ebf591e6edec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:46.310014 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1263/2541] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:46 2022] DELETE /identity/v3/projects/48d7058d8fce454e90696a0db566f7c6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:46.311631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.311912 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.312193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.339102 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:46.341470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:46.420803 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1279/2542] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:53:46.429366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.435194 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.435572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.457750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:46.459088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:46.469669 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1264/2543] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:46.475432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.484786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392fe5a-b169-49d9-9e67-b8471c4d2e8b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.492565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.493637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.493738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.494039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.494785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:53:46.495097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.496739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.511132 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1280/2544] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:53:46.515306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.527004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14a0b-b360-44b8-af45-96933d27354e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.532883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.533662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.533966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.534227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.534939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.536852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.578651 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1265/2545] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:46 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:46.581558 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.594458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144874b6-a233-47f5-9334-9854389abebc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.660191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.661267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.661597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.661956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.665205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.665349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.690418 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1281/2546] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:46 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:53:46.694222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.707822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc012-b183-4a49-9561-4a0003d3fb12 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.714074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.714752 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.715043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.715332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.716075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.717779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.730527 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1266/2547] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:53:46.734640 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.746549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e0df-b580-4348-918a-0abcf1b38304 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.752675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277289b8-ae4a-4cf3-9645-5d7b6a5da941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.753437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277289b8-ae4a-4cf3-9645-5d7b6a5da941 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.753859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277289b8-ae4a-4cf3-9645-5d7b6a5da941 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.754138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277289b8-ae4a-4cf3-9645-5d7b6a5da941 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.754906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277289b8-ae4a-4cf3-9645-5d7b6a5da941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.756531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277289b8-ae4a-4cf3-9645-5d7b6a5da941 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.769173 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1282/2548] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:46.773037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:46.784002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2073c-efd4-4524-8cff-0f79c2875190 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:46.790494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:46.791396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.791682 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.791961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] PATH_INFO: `/v3/projects/6b1349d670ff4e7aafc46f44a9f215ea/users/ec340ec615d44f3dbbdf7822506ca93c/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.818965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1349d670ff4e7aafc46f44a9f215ea, user_id=ec340ec615d44f3dbbdf7822506ca93c, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:46.822846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:46.857183 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1267/2549] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:46 2022] PUT /identity/v3/projects/6b1349d670ff4e7aafc46f44a9f215ea/users/ec340ec615d44f3dbbdf7822506ca93c/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:46.865041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:46.865715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:46.866204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:46.907294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] MFA Rules not processed for user `ec340ec615d44f3dbbdf7822506ca93c`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:46.908689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:46.953684 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:47.012308 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1283/2550] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:47.013597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.022642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:47.097272 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ce674-33ee-4df5-a73d-80579854444e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.104878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.105579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.105870 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.106143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.106855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.108799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.144875 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1268/2551] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:47 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:47.149430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.173092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104e135-7842-4dee-b398-aff5361e1b29 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.249075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.249779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.250057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.250329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.251477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.255087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.281499 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1284/2552] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:47 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:47.285277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.297953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b1ee5-4080-4ace-be9f-518d0a532a6e admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.303908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.304967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.305285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.305568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.306295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.307898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.323422 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1269/2553] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:47.328429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.343309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd717cc-9628-4356-b601-c14131f3d555 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.350223 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.351721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.352106 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.352391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] PATH_INFO: `/v3/projects/f357090fd8b844399fccf764d76ed16e/users/f0afc81b804c4929aa98e35eea2d78fb/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.372309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f357090fd8b844399fccf764d76ed16e, user_id=f0afc81b804c4929aa98e35eea2d78fb, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.375254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.391754 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1285/2554] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:47 2022] PUT /identity/v3/projects/f357090fd8b844399fccf764d76ed16e/users/f0afc81b804c4929aa98e35eea2d78fb/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:53:47.395671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.408260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d538c-5c87-44e8-ad41-caffb6b74433 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.480201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4d1d1-277d-42e9-8598-161033fef2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.481189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4d1d1-277d-42e9-8598-161033fef2ca admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.481538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4d1d1-277d-42e9-8598-161033fef2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.481826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4d1d1-277d-42e9-8598-161033fef2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.482564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4d1d1-277d-42e9-8598-161033fef2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.484205 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4d1d1-277d-42e9-8598-161033fef2ca admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.499796 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1270/2555] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:47.500902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.515005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc63d20-5579-476c-9097-711a436dc4ab admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.519965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.520845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.521120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.521538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] PATH_INFO: `/v3/projects/f357090fd8b844399fccf764d76ed16e/users/f0afc81b804c4929aa98e35eea2d78fb/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.524086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f357090fd8b844399fccf764d76ed16e, user_id=f0afc81b804c4929aa98e35eea2d78fb, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.528294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.540752 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1286/2556] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:47 2022] PUT /identity/v3/projects/f357090fd8b844399fccf764d76ed16e/users/f0afc81b804c4929aa98e35eea2d78fb/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:47.552038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.552357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.552661 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.586420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] MFA Rules not processed for user `f0afc81b804c4929aa98e35eea2d78fb`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:47.588234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:47.676156 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:47.680858 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1271/2557] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:47.693496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.696159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:47.767101 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1154a5-72eb-41ff-9035-3b81e5d42251 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.774728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.775400 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.775686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.775970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:47.786514 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:47.788009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:47.799104 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1287/2558] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:47.911073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:47.922108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8b83-c2ed-44bf-9c2f-520ffb93959b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:47.927152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f23627-cbf7-456d-bd7a-05920b52ad5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:47.927805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f23627-cbf7-456d-bd7a-05920b52ad5e service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:47.928088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f23627-cbf7-456d-bd7a-05920b52ad5e service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:47.928362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f23627-cbf7-456d-bd7a-05920b52ad5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:48.000431 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f23627-cbf7-456d-bd7a-05920b52ad5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:48.002024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f23627-cbf7-456d-bd7a-05920b52ad5e service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:48.017365 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1272/2559] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:50.756374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:50.783595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:50.822760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d854e7-60da-480e-9fe3-840a6db6efa7 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:50.827569 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:50.828470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:50.828751 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:50.829029 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] PATH_INFO: `/v3/users/ec340ec615d44f3dbbdf7822506ca93c` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:50.830305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec340ec615d44f3dbbdf7822506ca93c)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:50.832241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:50.882922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec340ec615d44f3dbbdf7822506ca93c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:50.889939 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec340ec615d44f3dbbdf7822506ca93c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:50.890615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec340ec615d44f3dbbdf7822506ca93c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:50.897647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec340ec615d44f3dbbdf7822506ca93c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:50.898365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec340ec615d44f3dbbdf7822506ca93c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:50.917199 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1288/2560] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:50 2022] DELETE /identity/v3/users/ec340ec615d44f3dbbdf7822506ca93c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:50.922085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:50.922607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:50.922760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:50.941420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:50.942711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:51.003911 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1273/2561] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:51.013401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:51.014890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:51.074281 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f220a-382c-4325-b9e4-b9040ee39239 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:51.077861 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:51.078498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:51.078779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:51.079053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:51.088468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:51.090116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:51.100329 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1289/2562] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:51.370144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:51.371576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:51.384467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1bf9e-164f-4ff1-a3f7-9080c3811ecc None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:51.389333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:51.390228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:51.390511 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:51.390788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] PATH_INFO: `/v3/projects/6b1349d670ff4e7aafc46f44a9f215ea` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:51.391996 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1349d670ff4e7aafc46f44a9f215ea)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:51.393958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:51.443745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1349d670ff4e7aafc46f44a9f215ea', 'request_id': 'req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.450425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1349d670ff4e7aafc46f44a9f215ea', 'request_id': 'req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.455908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1349d670ff4e7aafc46f44a9f215ea', 'request_id': 'req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.468645 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] The token cache is being invalidate because project 6b1349d670ff4e7aafc46f44a9f215ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:51.468924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.469567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.471110 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1274/2563] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:51 2022] DELETE /identity/v3/projects/6b1349d670ff4e7aafc46f44a9f215ea => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:51.475074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:51.484768 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e26b4a-57c5-4abf-b23c-c475d777432f service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:51.526309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:51.542752 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:51.543626 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:51.543905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:51.544177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] PATH_INFO: `/v3/users/f0afc81b804c4929aa98e35eea2d78fb` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:51.545368 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0afc81b804c4929aa98e35eea2d78fb)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:51.547405 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:51.592830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0afc81b804c4929aa98e35eea2d78fb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.599673 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0afc81b804c4929aa98e35eea2d78fb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.600972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0afc81b804c4929aa98e35eea2d78fb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.607807 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0afc81b804c4929aa98e35eea2d78fb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.608432 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c1fe39bf-35a5-4678-b6db-a3f34289e876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0afc81b804c4929aa98e35eea2d78fb'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:51.626827 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1290/2564] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:53:51 2022] DELETE /identity/v3/users/f0afc81b804c4929aa98e35eea2d78fb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:53:51.900417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:51.902158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:51.921318 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d2ea7-e11d-4d1a-b16f-984aa68442f0 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:51.949546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:51.988401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:51.989211 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:51.989501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:51.989781 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] PATH_INFO: `/v3/projects/f357090fd8b844399fccf764d76ed16e` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:51.991045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f357090fd8b844399fccf764d76ed16e)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:51.993769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.039074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f357090fd8b844399fccf764d76ed16e', 'request_id': 'req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:52.045215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f357090fd8b844399fccf764d76ed16e', 'request_id': 'req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:52.050709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f357090fd8b844399fccf764d76ed16e', 'request_id': 'req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:52.063236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] The token cache is being invalidate because project f357090fd8b844399fccf764d76ed16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:53:52.063524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:52.064142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d8ce96dc-93a6-4eac-8a0b-010dc97b11e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:53:52.065717 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1275/2565] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:53:51 2022] DELETE /identity/v3/projects/f357090fd8b844399fccf764d76ed16e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:52.071041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.071512 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.071610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.089873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:52.091052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:52.150997 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1291/2566] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:52.159856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.160149 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.160432 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.180484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:52.181777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:52.189818 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1276/2567] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:52.194388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.206186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843ada-688d-450a-80f3-cd6d1944be54 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.211287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.212355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.212911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.213450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.214700 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:53:52.215118 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.217419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.233660 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1292/2568] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:53:52.238688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.253234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925aff3-2052-4b11-bb88-2d4732589186 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.260852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.261560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.261841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.262118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.262828 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.265188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.294028 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1277/2569] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:52.298466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.308781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd737c-b4ba-475e-a494-986dd35f2db3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.361240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:52.373470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.374138 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.374421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.374702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.375382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.377347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.396904 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1293/2570] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:52.401107 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.411424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8229b94-2596-43f5-8362-c6505787938c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.416447 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.417111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.417426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.417706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.418429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.420021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.431108 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1278/2571] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:52.434955 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.445964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5907-3da2-40ad-b2fc-dab34d704746 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.450583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71e8c0-91b2-4ca1-ab23-dd8d033cd9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.451237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e8c0-91b2-4ca1-ab23-dd8d033cd9bd admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.451522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e8c0-91b2-4ca1-ab23-dd8d033cd9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.451800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71e8c0-91b2-4ca1-ab23-dd8d033cd9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.452516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71e8c0-91b2-4ca1-ab23-dd8d033cd9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.454182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71e8c0-91b2-4ca1-ab23-dd8d033cd9bd admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.464581 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1294/2572] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:52.468680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.478648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0300-96c1-4d41-9047-2b5dec10963a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.483284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.484154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.484441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.484724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] PATH_INFO: `/v3/projects/40a61643482647dd858f2e87f3eb275f/users/faeb872204ca4de38cc4746e8cf5c1d8/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.502111 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a61643482647dd858f2e87f3eb275f, user_id=faeb872204ca4de38cc4746e8cf5c1d8, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.504855 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.519654 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1279/2573] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:52 2022] PUT /identity/v3/projects/40a61643482647dd858f2e87f3eb275f/users/faeb872204ca4de38cc4746e8cf5c1d8/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:52.530559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.530887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.531152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.559357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] MFA Rules not processed for user `faeb872204ca4de38cc4746e8cf5c1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:52.560591 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:52.629117 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1295/2574] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:52.633836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.682485 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:52.697787 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffe6a-60e8-4311-b0bd-01eaa0eedac8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.702442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.703103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.703395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.703679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.704387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.706322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.733425 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1280/2575] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:52.737517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.748185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f98303-bfdf-4fb9-99c8-e35934dc5dda None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.806165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.806755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.807037 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.807314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.808009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.809960 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.829174 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1296/2576] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:53:52 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:53:52.833422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.844257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f73b-85c0-47a1-bbe5-ecbe660b7f02 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.848860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.849562 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.849845 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.850122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.851513 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.853101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.864877 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1281/2577] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:52.869593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.879922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec580-adf7-493f-b8a8-14a13cf5c800 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.885083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.886104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.886469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.886822 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] PATH_INFO: `/v3/projects/519cdd9ae7bc49af8b593f503b694f38/users/bfab24ef5d2b4a758256d33126df6a38/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.902905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519cdd9ae7bc49af8b593f503b694f38, user_id=bfab24ef5d2b4a758256d33126df6a38, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.906323 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:52.922736 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1297/2578] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:52 2022] PUT /identity/v3/projects/519cdd9ae7bc49af8b593f503b694f38/users/bfab24ef5d2b4a758256d33126df6a38/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:53:52.926668 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:52.937953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da624b1-65f0-40a4-8351-83c795801bad admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:52.996135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045e1d3-bae5-45fc-92a7-d63061b4734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:52.996809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e1d3-bae5-45fc-92a7-d63061b4734c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:52.997076 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e1d3-bae5-45fc-92a7-d63061b4734c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:52.997384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e1d3-bae5-45fc-92a7-d63061b4734c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:52.998108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045e1d3-bae5-45fc-92a7-d63061b4734c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:52.999710 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045e1d3-bae5-45fc-92a7-d63061b4734c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:53.013131 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1282/2579] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:53:53.014344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:53.025719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3726b94-e011-403d-b473-7a89ba554268 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:53.030652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:53.031671 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:53.032272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:53.032674 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] PATH_INFO: `/v3/projects/519cdd9ae7bc49af8b593f503b694f38/users/bfab24ef5d2b4a758256d33126df6a38/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:53.036327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519cdd9ae7bc49af8b593f503b694f38, user_id=bfab24ef5d2b4a758256d33126df6a38, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:53.039982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:53.061527 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1298/2580] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:53:53 2022] PUT /identity/v3/projects/519cdd9ae7bc49af8b593f503b694f38/users/bfab24ef5d2b4a758256d33126df6a38/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:53:53.063311 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884df039-7afd-45ec-8019-09896d418e28 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:53.063605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884df039-7afd-45ec-8019-09896d418e28 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:53.063883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884df039-7afd-45ec-8019-09896d418e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:53.113195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-884df039-7afd-45ec-8019-09896d418e28 None None] MFA Rules not processed for user `bfab24ef5d2b4a758256d33126df6a38`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:53.113195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-884df039-7afd-45ec-8019-09896d418e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:53.188927 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1283/2581] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:53:53.201237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:53.204198 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:53.222666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:53.285422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10a91f-af31-4b17-8c1a-be24036f9032 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:53.289970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:53.290659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:53.290969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:53.291257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:53.367612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:53.388251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:53.389275 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1299/2582] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:53:55.742188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:55.742676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:55.742796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:55.761007 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:53:55.762217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:55.803707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:55.820481 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1284/2583] 10.222.0.45 () {58 vars in 1009 bytes} [Mon May 23 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:53:55.832160 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:55.833587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:53:55.902186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872fe1-6391-4fd4-b9e6-f9f40ba080fd service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:55.907111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:55.907746 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:55.908028 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:55.908304 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:55.916551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:55.918170 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:55.926216 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1300/2584] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:53:57.777938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:53:57.787500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6a0fc-f01a-4083-a096-6612979083fe None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:53:57.791685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa11282-20c5-42a1-8b6e-0fad23acc942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:53:57.792479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11282-20c5-42a1-8b6e-0fad23acc942 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:53:57.792763 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11282-20c5-42a1-8b6e-0fad23acc942 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:53:57.793041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11282-20c5-42a1-8b6e-0fad23acc942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:53:57.804961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa11282-20c5-42a1-8b6e-0fad23acc942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:53:57.806527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa11282-20c5-42a1-8b6e-0fad23acc942 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:53:57.819162 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1285/2585] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:02.823064 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:02.888917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=100 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:02.895347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f392e7e-0473-4662-804f-568e1d7605bb service swift] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:02.901641 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:02.902648 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:02.903027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:02.903402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] PATH_INFO: `/v3/users/faeb872204ca4de38cc4746e8cf5c1d8` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:02.904980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faeb872204ca4de38cc4746e8cf5c1d8)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:02.907112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:02.958837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faeb872204ca4de38cc4746e8cf5c1d8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:02.969759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faeb872204ca4de38cc4746e8cf5c1d8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:02.970796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faeb872204ca4de38cc4746e8cf5c1d8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:02.979364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faeb872204ca4de38cc4746e8cf5c1d8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:02.980054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faeb872204ca4de38cc4746e8cf5c1d8'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:02.997982 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1301/2586] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:02 2022] DELETE /identity/v3/users/faeb872204ca4de38cc4746e8cf5c1d8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:03.002891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:03.003426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:03.003537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:03.022249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:03.023491 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:03.093495 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1286/2587] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:54:03.100448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:03.102014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:03.163200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b8ce5-e546-4854-bf7b-855099d0a285 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:03.166932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:03.168158 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:03.168446 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:03.168720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:03.180962 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:03.182560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:03.193522 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1302/2588] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:03.753499 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:03.755115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:03.769123 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac98e-cd51-43b3-b3e5-6a1644b73233 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:03.780954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:03.782063 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:03.782417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:03.782780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] PATH_INFO: `/v3/projects/40a61643482647dd858f2e87f3eb275f` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:03.784129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a61643482647dd858f2e87f3eb275f)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:03.786239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:03.843223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a61643482647dd858f2e87f3eb275f', 'request_id': 'req-b46de003-df98-471e-8e49-dcd63038c559'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:03.851049 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a61643482647dd858f2e87f3eb275f', 'request_id': 'req-b46de003-df98-471e-8e49-dcd63038c559'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:03.856801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a61643482647dd858f2e87f3eb275f', 'request_id': 'req-b46de003-df98-471e-8e49-dcd63038c559'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:03.870329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] The token cache is being invalidate because project 40a61643482647dd858f2e87f3eb275f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:03.870619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:03.871247 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:03.872810 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1287/2589] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:03 2022] DELETE /identity/v3/projects/40a61643482647dd858f2e87f3eb275f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:03.876770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:03.887004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9c08-27f2-4b6b-a6c0-a6efe6254d20 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:03.947215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:03.948080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:03.948358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:03.948631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] PATH_INFO: `/v3/users/bfab24ef5d2b4a758256d33126df6a38` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:03.949809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfab24ef5d2b4a758256d33126df6a38)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:03.951815 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:03.974072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:04.001764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfab24ef5d2b4a758256d33126df6a38'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.009947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfab24ef5d2b4a758256d33126df6a38'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.010631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfab24ef5d2b4a758256d33126df6a38'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.018038 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfab24ef5d2b4a758256d33126df6a38'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.018638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c3bf356c-5997-4766-b04e-f4e32814ea6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfab24ef5d2b4a758256d33126df6a38'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.040116 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1303/2590] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:03 2022] DELETE /identity/v3/users/bfab24ef5d2b4a758256d33126df6a38 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:04.325942 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.331958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:04.353494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de003-df98-471e-8e49-dcd63038c559 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.412241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.414147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.414434 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.414748 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] PATH_INFO: `/v3/projects/519cdd9ae7bc49af8b593f503b694f38` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.416100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=519cdd9ae7bc49af8b593f503b694f38)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.418210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.419868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:04.466824 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519cdd9ae7bc49af8b593f503b694f38', 'request_id': 'req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.473094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519cdd9ae7bc49af8b593f503b694f38', 'request_id': 'req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.479401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519cdd9ae7bc49af8b593f503b694f38', 'request_id': 'req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.492238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] The token cache is being invalidate because project 519cdd9ae7bc49af8b593f503b694f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:04.492526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.493196 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-5b0ecd42-7dbb-4885-9395-9d47d8c517ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:04.494794 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1288/2591] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:04 2022] DELETE /identity/v3/projects/519cdd9ae7bc49af8b593f503b694f38 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:04.500647 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.500934 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.501242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.519406 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:04.520550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:04.579602 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1304/2592] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:04.589974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.590271 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.590552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.608795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:04.610043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:04.618499 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1289/2593] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:04.622655 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.632435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9312a-59bc-472f-8e91-9874acaf4464 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.637517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.638159 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.638441 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.638710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.639415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:54:04.639719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.641335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.655069 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1305/2594] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:54:04.659508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.669761 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42279364-7074-4d24-bc2f-ccf575e3c3db None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.674360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.675008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.675284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.675557 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.676248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.678408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.703386 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1290/2595] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:04 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:04.707491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.718573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd966c1-a963-46a2-ab8f-7a27d3867643 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.775319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.775907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.776188 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.776463 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.777172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.779083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.798671 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1306/2596] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:04 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:54:04.802800 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.814295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e853099-4b1b-4b42-b6db-33981b1a2ac3 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.819784 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.820472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.820755 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.821056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.821877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.823489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.833852 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1291/2597] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:04.838778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.849715 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecccfe-c13a-4eb4-b557-1b3e44dc5fad admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.854504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8641-d0af-4b1f-905a-5cbafc236007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.855158 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8641-d0af-4b1f-905a-5cbafc236007 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.855439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8641-d0af-4b1f-905a-5cbafc236007 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.855713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8641-d0af-4b1f-905a-5cbafc236007 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.856425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8641-d0af-4b1f-905a-5cbafc236007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.858067 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8641-d0af-4b1f-905a-5cbafc236007 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.868756 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1307/2598] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:04.872848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:04.884118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6b13a-0f07-45a2-9f53-5c6150530047 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:04.888860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:04.889791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.890074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.890352 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] PATH_INFO: `/v3/projects/8fc03be9c421403394e4aaaee3d913e5/users/b4dfb213e4b4462dbbf1094c27c06e3a/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.906635 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc03be9c421403394e4aaaee3d913e5, user_id=b4dfb213e4b4462dbbf1094c27c06e3a, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:04.909326 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:04.925198 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1292/2599] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:04 2022] PUT /identity/v3/projects/8fc03be9c421403394e4aaaee3d913e5/users/b4dfb213e4b4462dbbf1094c27c06e3a/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:04.937124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:04.937632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:04.937997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:04.944511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:04.970875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] MFA Rules not processed for user `b4dfb213e4b4462dbbf1094c27c06e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:04.972187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:05.039181 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1308/2600] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:05.050023 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:05.051747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:05.108920 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265370-da8b-48b8-95fd-eb01fef29a20 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:05.112544 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13d82-e311-4028-9667-3b8c1ccb2a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:05.113203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13d82-e311-4028-9667-3b8c1ccb2a52 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:05.113488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13d82-e311-4028-9667-3b8c1ccb2a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:05.113764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13d82-e311-4028-9667-3b8c1ccb2a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:05.122840 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13d82-e311-4028-9667-3b8c1ccb2a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:05.124253 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13d82-e311-4028-9667-3b8c1ccb2a52 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:05.133027 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1293/2601] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:08.118504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:08.183510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b75283-32a2-40ef-aa43-9d42a2a8a829 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:08.188165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:08.189039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:08.189355 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:08.189634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] PATH_INFO: `/v3/users/b4dfb213e4b4462dbbf1094c27c06e3a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:08.190835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dfb213e4b4462dbbf1094c27c06e3a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:08.192820 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:08.238825 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dfb213e4b4462dbbf1094c27c06e3a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.246414 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dfb213e4b4462dbbf1094c27c06e3a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.247085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dfb213e4b4462dbbf1094c27c06e3a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.254267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dfb213e4b4462dbbf1094c27c06e3a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.254949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dfb213e4b4462dbbf1094c27c06e3a'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.273852 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1309/2602] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:08 2022] DELETE /identity/v3/users/b4dfb213e4b4462dbbf1094c27c06e3a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:54:08.278402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:08.278903 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:08.279017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:08.296147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:08.297373 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:08.322550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:08.359734 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1294/2603] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:08.370192 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:08.371660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:08.386483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:08.438515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed3bd3-9948-4f8f-9471-27e442d26396 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:08.442148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653f8ec-2c1e-4080-8651-9953fd5e2310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:08.442800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653f8ec-2c1e-4080-8651-9953fd5e2310 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:08.443087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653f8ec-2c1e-4080-8651-9953fd5e2310 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:08.443363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653f8ec-2c1e-4080-8651-9953fd5e2310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:08.453544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653f8ec-2c1e-4080-8651-9953fd5e2310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:08.454994 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653f8ec-2c1e-4080-8651-9953fd5e2310 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:08.465648 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1310/2604] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:08.873165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:08.874676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:08.887859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761f68-a284-4195-96ec-f7f8f5518dc2 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:08.893762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091652e-0747-4868-b446-74350a57956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:08.894564 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091652e-0747-4868-b446-74350a57956d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:08.894867 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091652e-0747-4868-b446-74350a57956d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:08.895109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091652e-0747-4868-b446-74350a57956d admin admin] PATH_INFO: `/v3/projects/8fc03be9c421403394e4aaaee3d913e5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:08.897642 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091652e-0747-4868-b446-74350a57956d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc03be9c421403394e4aaaee3d913e5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:08.899577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091652e-0747-4868-b446-74350a57956d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:08.948899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6091652e-0747-4868-b446-74350a57956d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc03be9c421403394e4aaaee3d913e5', 'request_id': 'req-6091652e-0747-4868-b446-74350a57956d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.954976 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6091652e-0747-4868-b446-74350a57956d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc03be9c421403394e4aaaee3d913e5', 'request_id': 'req-6091652e-0747-4868-b446-74350a57956d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.960977 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6091652e-0747-4868-b446-74350a57956d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc03be9c421403394e4aaaee3d913e5', 'request_id': 'req-6091652e-0747-4868-b446-74350a57956d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.973286 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6091652e-0747-4868-b446-74350a57956d admin admin] The token cache is being invalidate because project 8fc03be9c421403394e4aaaee3d913e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:08.973576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6091652e-0747-4868-b446-74350a57956d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.974200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-6091652e-0747-4868-b446-74350a57956d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:08.975744 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1295/2605] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:08 2022] DELETE /identity/v3/projects/8fc03be9c421403394e4aaaee3d913e5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:08.981271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:08.981566 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:08.981852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:08.999642 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:09.000858 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:09.063348 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1311/2606] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:54:09.072110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.072402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.072768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.092703 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:09.093928 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:09.102420 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1296/2607] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:09.106713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.116440 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3cc4d-2f22-4389-a002-dba8bc3cef71 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.121298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.121945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.122226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.122502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.123241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:54:09.123546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.125162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.136928 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1312/2608] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:54:09.141124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.150864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7241d23-afdd-4e29-a189-2ab74c1cdf12 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.155314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.155954 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.156235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.156510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.157361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.159258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.185414 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1297/2609] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:09.189398 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.199817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b2553-5c01-4d3b-9e5a-ccac78b0034c admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.256280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.256946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.257759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.258035 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.258709 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.260622 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.280056 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1313/2610] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:09.284209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.294292 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847b2b-7a9a-4593-bab8-4cfb2e3f6f22 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.298804 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.299451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.299730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.300004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.300724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.302345 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.312696 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1298/2611] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:09.316421 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.326910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a298e0-56cd-4f2f-a90b-32b9b474a2f1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.331489 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91c8c-e581-4efc-9d5b-20084eca0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.332147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c8c-e581-4efc-9d5b-20084eca0579 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.332429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c8c-e581-4efc-9d5b-20084eca0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.332702 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91c8c-e581-4efc-9d5b-20084eca0579 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.333466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91c8c-e581-4efc-9d5b-20084eca0579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.335056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91c8c-e581-4efc-9d5b-20084eca0579 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.346101 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1314/2612] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:09.350138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.360409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e53d-263c-4409-82c5-65a739557754 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.365009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.365904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.366185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.366463 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] PATH_INFO: `/v3/projects/8439e9e04bc245e19cafb6c810b3d7bc/users/ee5c85015a624c35bb998eb20ca10754/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.381110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8439e9e04bc245e19cafb6c810b3d7bc, user_id=ee5c85015a624c35bb998eb20ca10754, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.384885 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.397187 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1299/2613] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:09 2022] PUT /identity/v3/projects/8439e9e04bc245e19cafb6c810b3d7bc/users/ee5c85015a624c35bb998eb20ca10754/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:09.408347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.408682 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.408967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.438026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] MFA Rules not processed for user `ee5c85015a624c35bb998eb20ca10754`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:09.439257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:09.447890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:09.504310 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1315/2614] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:09.509622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.557951 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:09.574363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd9ae-3b5f-4ed9-bb34-19d786cf79d7 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.580018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.580395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.580488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.581106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.581574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.583517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.619472 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1300/2615] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:09.620624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.634753 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82124f1d-44de-489b-ad32-e5509f189fb0 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.708522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.709242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.709583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.709870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.712265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.714130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.741550 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1316/2616] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:09.745389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.757223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c482-d029-4849-b542-cced2d83b36f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.762287 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.762959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.763285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.763712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.764759 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.766453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.782372 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1301/2617] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:54:09.783888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.795854 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957756da-2aef-4a86-82a9-ea07501da6c1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.803855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a117-3fd1-47fb-a9e0-c1a6a39bbcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.805528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a117-3fd1-47fb-a9e0-c1a6a39bbcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.805859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a117-3fd1-47fb-a9e0-c1a6a39bbcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.806137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a117-3fd1-47fb-a9e0-c1a6a39bbcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.806867 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837a117-3fd1-47fb-a9e0-c1a6a39bbcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.808580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837a117-3fd1-47fb-a9e0-c1a6a39bbcc7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.819262 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1317/2618] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:09.824059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:09.834236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8169eb-5f89-4902-9b3d-1fa8f0f923db admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:09.839222 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:09.840163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.840450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.840727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] PATH_INFO: `/v3/projects/d97e472c76e74d37ba8cc3fdf5760a2a/users/7a939cb7bf1040269f5844406d817e5b/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.855728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97e472c76e74d37ba8cc3fdf5760a2a, user_id=7a939cb7bf1040269f5844406d817e5b, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:09.858524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:09.873244 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1302/2619] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:09 2022] PUT /identity/v3/projects/d97e472c76e74d37ba8cc3fdf5760a2a/users/7a939cb7bf1040269f5844406d817e5b/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:54:09.886756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:09.887053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:09.887332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:09.915147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] MFA Rules not processed for user `7a939cb7bf1040269f5844406d817e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:09.916385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:09.984345 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1318/2620] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:09.988838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.050594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b622-20c5-4b7c-b0bb-5a2c050ca552 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.055915 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.056631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.056914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.057231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.057921 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.059822 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.086602 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1303/2621] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:09 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:10.091055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.102255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8392f-a62a-4294-92ba-128a73a4956e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.114287 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:10.162542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.163238 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.164021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.164295 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.164978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.166964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.187653 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1319/2622] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:10 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:10.191579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.202099 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57506-5fab-4b4a-8a49-64fd461c8150 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.206647 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.207239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.207519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.207793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.208508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.210118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.225169 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1304/2623] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:10.227522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.237684 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8a17-2460-48c6-b780-2ad7feb6040b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.243027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.244010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.244302 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.244580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] PATH_INFO: `/v3/projects/5e79877c90734b39b8fc7edb37bbca9a/users/e1ad91a0e3204a94835a2ed510466097/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.259176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e79877c90734b39b8fc7edb37bbca9a, user_id=e1ad91a0e3204a94835a2ed510466097, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.261895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.275150 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1320/2624] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:10 2022] PUT /identity/v3/projects/5e79877c90734b39b8fc7edb37bbca9a/users/e1ad91a0e3204a94835a2ed510466097/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:10.279193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.289614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b525-c73b-4413-b665-b0cf3852db68 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.345746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5467f-fc7f-4e0d-801a-4b253cc1b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.346414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5467f-fc7f-4e0d-801a-4b253cc1b0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.346697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5467f-fc7f-4e0d-801a-4b253cc1b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.346974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5467f-fc7f-4e0d-801a-4b253cc1b0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.347688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5467f-fc7f-4e0d-801a-4b253cc1b0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.349297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5467f-fc7f-4e0d-801a-4b253cc1b0b5 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.359915 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1305/2625] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:54:10.364240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.374731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891b819-bda3-426a-8db1-820c0e96ccc1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.379319 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.380186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.380465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.380739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] PATH_INFO: `/v3/projects/5e79877c90734b39b8fc7edb37bbca9a/users/e1ad91a0e3204a94835a2ed510466097/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.382779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e79877c90734b39b8fc7edb37bbca9a, user_id=e1ad91a0e3204a94835a2ed510466097, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.385444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.395511 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1321/2626] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:10 2022] PUT /identity/v3/projects/5e79877c90734b39b8fc7edb37bbca9a/users/e1ad91a0e3204a94835a2ed510466097/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:10.407101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3ab6d-d266-4551-81a6-b820e6c87489 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.407390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3ab6d-d266-4551-81a6-b820e6c87489 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.407694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3ab6d-d266-4551-81a6-b820e6c87489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.426549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:10.437869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8fe3ab6d-d266-4551-81a6-b820e6c87489 None None] MFA Rules not processed for user `e1ad91a0e3204a94835a2ed510466097`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:10.439069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8fe3ab6d-d266-4551-81a6-b820e6c87489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:10.507850 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1306/2627] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:10.519009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:10.520723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:10.577871 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e86c62-5b8b-4f4b-ab10-ad6930280970 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:10.581454 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:10.582098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:10.582363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:10.582636 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:10.638880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:10.640313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:10.649978 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1322/2628] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:11.515055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:11.515501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:11.515598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:11.533600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] MFA Rules not processed for user `9ea2526f970f4d069dd6af31de04e340`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:11.534805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:11.592074 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1307/2629] 10.222.0.45 () {58 vars in 967 bytes} [Mon May 23 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:11.604814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:11.606240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:11.635695 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:11.677842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec84b-5960-454b-8eef-98a302816c97 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:11.683488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9ea8c8127b48c483bd5e06b641253f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:11.684130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:11.684412 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:11.684689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:11.692817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:11.694455 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:11.702684 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1323/2630] 10.222.0.45 () {60 vars in 1384 bytes} [Mon May 23 12:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:54:12.181566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:12.183001 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:12.195877 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58727f4e-1c62-4927-8f04-483606198aa1 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:12.200203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:12.200861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:12.201191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:12.201456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:12.262737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:12.264102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:12.273621 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1308/2631] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:54:12.778410 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:12.790051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0290-185e-46be-b6dd-259e2056962c service swift] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:12.793617 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28518f-6868-4c05-99e2-1f1abee1804c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:12.794251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28518f-6868-4c05-99e2-1f1abee1804c service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:12.794531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28518f-6868-4c05-99e2-1f1abee1804c service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:12.794824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28518f-6868-4c05-99e2-1f1abee1804c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:12.804000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28518f-6868-4c05-99e2-1f1abee1804c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:12.805808 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28518f-6868-4c05-99e2-1f1abee1804c service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:12.815225 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1324/2632] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:16.652113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:16.694005 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:16.715982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb046b-40cc-4ef3-b067-094faf009895 service cinder] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:16.720452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:16.721341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:16.721627 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:16.721908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] PATH_INFO: `/v3/users/ee5c85015a624c35bb998eb20ca10754` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:16.723086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5c85015a624c35bb998eb20ca10754)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:16.725015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:16.770857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5c85015a624c35bb998eb20ca10754'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:16.778026 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5c85015a624c35bb998eb20ca10754'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:16.778693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5c85015a624c35bb998eb20ca10754'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:16.791113 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5c85015a624c35bb998eb20ca10754'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:16.797898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5c85015a624c35bb998eb20ca10754'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:16.803669 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1309/2633] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:16 2022] DELETE /identity/v3/users/ee5c85015a624c35bb998eb20ca10754 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:16.808857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:16.809379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:16.809477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:16.826530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:16.827729 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:16.887549 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1325/2634] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:16.897073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:16.898579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:16.958380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba967e4-bc1f-4482-8ebf-fe2a4b6b320c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:16.963341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:16.963988 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:16.964269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:16.964542 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:16.973534 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:16.975082 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:16.985507 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1310/2635] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:17.248833 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:17.250301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:17.262727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f2a8-052f-4ff8-aaf8-5074aa4e1213 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:17.267595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:17.268565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:17.268844 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:17.269117 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] PATH_INFO: `/v3/projects/8439e9e04bc245e19cafb6c810b3d7bc` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:17.270992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8439e9e04bc245e19cafb6c810b3d7bc)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:17.273681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:17.322544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8439e9e04bc245e19cafb6c810b3d7bc', 'request_id': 'req-c56d45fe-7250-4f4f-81f2-5b6b564341c4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.328182 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8439e9e04bc245e19cafb6c810b3d7bc', 'request_id': 'req-c56d45fe-7250-4f4f-81f2-5b6b564341c4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.334571 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8439e9e04bc245e19cafb6c810b3d7bc', 'request_id': 'req-c56d45fe-7250-4f4f-81f2-5b6b564341c4'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.349610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] The token cache is being invalidate because project 8439e9e04bc245e19cafb6c810b3d7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:17.349916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.350543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.352088 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1326/2636] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:17 2022] DELETE /identity/v3/projects/8439e9e04bc245e19cafb6c810b3d7bc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:17.356578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:17.366066 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1a316-8992-4f25-81e1-c462677cf8b3 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:17.422482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:17.423276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:17.423560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:17.423839 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] PATH_INFO: `/v3/users/7a939cb7bf1040269f5844406d817e5b` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:17.425064 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a939cb7bf1040269f5844406d817e5b)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:17.427018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:17.428461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:17.475391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a939cb7bf1040269f5844406d817e5b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.482482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a939cb7bf1040269f5844406d817e5b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.483143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a939cb7bf1040269f5844406d817e5b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.494803 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a939cb7bf1040269f5844406d817e5b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.501846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a939cb7bf1040269f5844406d817e5b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.507631 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1311/2637] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:17 2022] DELETE /identity/v3/users/7a939cb7bf1040269f5844406d817e5b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:17.781779 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:17.783207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:17.797548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d45fe-7250-4f4f-81f2-5b6b564341c4 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:17.819545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:17.858307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:17.859166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:17.859444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:17.859716 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] PATH_INFO: `/v3/projects/d97e472c76e74d37ba8cc3fdf5760a2a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:17.860875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97e472c76e74d37ba8cc3fdf5760a2a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:17.862876 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:17.909905 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97e472c76e74d37ba8cc3fdf5760a2a', 'request_id': 'req-f1905f06-7b73-428a-8b62-d8d7976dc00e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.915284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97e472c76e74d37ba8cc3fdf5760a2a', 'request_id': 'req-f1905f06-7b73-428a-8b62-d8d7976dc00e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.921332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97e472c76e74d37ba8cc3fdf5760a2a', 'request_id': 'req-f1905f06-7b73-428a-8b62-d8d7976dc00e'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.934150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] The token cache is being invalidate because project d97e472c76e74d37ba8cc3fdf5760a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:17.934434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.935041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:17.936588 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1327/2638] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:17 2022] DELETE /identity/v3/projects/d97e472c76e74d37ba8cc3fdf5760a2a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:17.940563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:17.942012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:17.955185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77215-e142-4ef1-804f-a89665acffbe admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.010850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.011715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.011998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.012279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] PATH_INFO: `/v3/users/e1ad91a0e3204a94835a2ed510466097` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.013488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ad91a0e3204a94835a2ed510466097)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.015394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.060587 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ad91a0e3204a94835a2ed510466097'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.067591 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ad91a0e3204a94835a2ed510466097'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.068257 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ad91a0e3204a94835a2ed510466097'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.082225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ad91a0e3204a94835a2ed510466097'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.090586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-99780e32-d418-4f06-b318-ed628172f021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ad91a0e3204a94835a2ed510466097'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.092194 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:18.097578 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1312/2639] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:17 2022] DELETE /identity/v3/users/e1ad91a0e3204a94835a2ed510466097 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:18.372982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.374439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:18.388211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1905f06-7b73-428a-8b62-d8d7976dc00e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.448261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.449123 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.449439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.449717 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] PATH_INFO: `/v3/projects/5e79877c90734b39b8fc7edb37bbca9a` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.450890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e79877c90734b39b8fc7edb37bbca9a)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.452811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.500061 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e79877c90734b39b8fc7edb37bbca9a', 'request_id': 'req-35362411-ada7-447b-ae87-c477fd957990'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.504548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:18.505738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e79877c90734b39b8fc7edb37bbca9a', 'request_id': 'req-35362411-ada7-447b-ae87-c477fd957990'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.512933 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e79877c90734b39b8fc7edb37bbca9a', 'request_id': 'req-35362411-ada7-447b-ae87-c477fd957990'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.526864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] The token cache is being invalidate because project 5e79877c90734b39b8fc7edb37bbca9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:18.527340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.527951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-35362411-ada7-447b-ae87-c477fd957990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:18.529528 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1328/2640] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:18 2022] DELETE /identity/v3/projects/5e79877c90734b39b8fc7edb37bbca9a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:18.534566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.534858 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.535143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.553878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:18.555019 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:18.614627 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1313/2641] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:18.622429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.622724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.623009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.640975 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:18.642205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:18.650645 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1329/2642] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:18.654662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.664347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee07404-4d8e-4e81-a59f-fdabafb90e80 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.670225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.670882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.671169 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.671450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.672174 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:54:18.672487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.674144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.685717 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1314/2643] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:54:18.689919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.699313 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5116fc-b385-4227-96c3-04273bdb40e5 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.703935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.704574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.704856 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.705132 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.705830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.707725 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.733134 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1330/2644] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:18 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:18.737128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.747798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ef4e-5d03-4059-b4bd-c8faa0646bd6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.804445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.805046 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.805362 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.806296 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.806986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.808909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.828793 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1315/2645] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:18 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:18.832917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.843609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0155-6b8c-4760-8760-b1a07393548e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.848175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.848827 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.849110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.849419 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.850137 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.851738 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.862060 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1331/2646] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:18.865838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.876580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d618ca9-1f07-4898-9c8a-8749f7060cc8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.881119 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9758a2c-055b-4bc6-a2e9-54d09bf56ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.881793 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758a2c-055b-4bc6-a2e9-54d09bf56ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.882074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758a2c-055b-4bc6-a2e9-54d09bf56ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.882357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758a2c-055b-4bc6-a2e9-54d09bf56ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.883239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9758a2c-055b-4bc6-a2e9-54d09bf56ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.885709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9758a2c-055b-4bc6-a2e9-54d09bf56ac8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.897439 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1316/2647] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:18.901749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:18.912547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a4aa-02b5-4bc3-9cb7-e2c15a404d48 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:18.917794 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:18.919639 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.919922 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.920200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] PATH_INFO: `/v3/projects/a19e5bf51c4b4379a2e0e3fc08ffd52d/users/3df8edd42d904771bdecf158e482898a/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.935191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19e5bf51c4b4379a2e0e3fc08ffd52d, user_id=3df8edd42d904771bdecf158e482898a, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:18.937918 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:18.951447 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1332/2648] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:18 2022] PUT /identity/v3/projects/a19e5bf51c4b4379a2e0e3fc08ffd52d/users/3df8edd42d904771bdecf158e482898a/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:54:18.963548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:18.964035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:18.964131 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:18.990439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] MFA Rules not processed for user `3df8edd42d904771bdecf158e482898a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:18.991663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:19.046069 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:19.057463 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1317/2649] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:19.067923 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:19.069627 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:19.125961 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e7d1e-513b-44c0-83fa-dad090f9d90e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:19.129559 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4481-4990-42d8-930e-ff6fdb7cac00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:19.130307 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4481-4990-42d8-930e-ff6fdb7cac00 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:19.130589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4481-4990-42d8-930e-ff6fdb7cac00 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:19.130865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4481-4990-42d8-930e-ff6fdb7cac00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:19.139902 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4481-4990-42d8-930e-ff6fdb7cac00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:19.141477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4481-4990-42d8-930e-ff6fdb7cac00 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:19.150814 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1333/2650] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:28.945631 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:29.011571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72338716-b636-4731-a4f8-ec241eb21f0a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:29.016144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:29.017012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:29.017344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:29.017626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] PATH_INFO: `/v3/users/3df8edd42d904771bdecf158e482898a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:29.018820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df8edd42d904771bdecf158e482898a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:29.020760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:29.069241 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df8edd42d904771bdecf158e482898a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.076519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df8edd42d904771bdecf158e482898a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.077227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df8edd42d904771bdecf158e482898a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.090161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df8edd42d904771bdecf158e482898a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.098662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df8edd42d904771bdecf158e482898a'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.105637 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1318/2651] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:28 2022] DELETE /identity/v3/users/3df8edd42d904771bdecf158e482898a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:29.110324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:29.110811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:29.110909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:29.128876 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:29.130109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:29.189479 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1334/2652] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:29.199782 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:29.201284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:29.263380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1e55e-cb02-4e64-b6ee-69b0e1abc003 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:29.267209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:29.267862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:29.268150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:29.268420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:29.277648 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:29.279065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:29.288335 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1319/2653] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:29.548801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:29.550434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:29.564773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17542fa-0070-4b72-9130-384899dfd09d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:29.569365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:29.570322 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:29.570491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:29.570767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] PATH_INFO: `/v3/projects/a19e5bf51c4b4379a2e0e3fc08ffd52d` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:29.571948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19e5bf51c4b4379a2e0e3fc08ffd52d)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:29.574606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:29.596756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:29.625909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19e5bf51c4b4379a2e0e3fc08ffd52d', 'request_id': 'req-f0a55216-9c0e-439e-be4c-88fa4e8248a9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.631686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19e5bf51c4b4379a2e0e3fc08ffd52d', 'request_id': 'req-f0a55216-9c0e-439e-be4c-88fa4e8248a9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.638523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19e5bf51c4b4379a2e0e3fc08ffd52d', 'request_id': 'req-f0a55216-9c0e-439e-be4c-88fa4e8248a9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.650893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] The token cache is being invalidate because project a19e5bf51c4b4379a2e0e3fc08ffd52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:29.651178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.652431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:29.654183 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1335/2654] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:29 2022] DELETE /identity/v3/projects/a19e5bf51c4b4379a2e0e3fc08ffd52d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:54:39.284246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:39.647896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:49.006132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:49.007554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:49.019619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a45a-fb9f-4dfd-8b20-8558fc610b05 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:49.068306 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:49.068952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:49.069269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:49.069549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:49.071335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:49.133907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:49.135335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:49.145589 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1320/2655] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:52.212196 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.213880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:52.229359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a55216-9c0e-439e-be4c-88fa4e8248a9 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:52.234582 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:52.235493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.235759 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.236162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] PATH_INFO: `/v3/users/d23ca857b76540ce83053424b710697b` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.237291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23ca857b76540ce83053424b710697b)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:52.239218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:52.286458 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23ca857b76540ce83053424b710697b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.296402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23ca857b76540ce83053424b710697b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.296720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23ca857b76540ce83053424b710697b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.304546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23ca857b76540ce83053424b710697b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.305259 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4f8550e1-4a58-4808-9701-cc144d8abcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23ca857b76540ce83053424b710697b'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.322882 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1336/2656] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:52 2022] DELETE /identity/v3/users/d23ca857b76540ce83053424b710697b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:52.493732 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.505695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9e53-1496-4e24-90a7-1a15c6903ca8 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:52.564390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:52.565275 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.565558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.565832 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] PATH_INFO: `/v3/projects/d6700b35745e4290b820f91719b249d4` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.567140 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6700b35745e4290b820f91719b249d4)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:52.569036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:52.615190 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6700b35745e4290b820f91719b249d4', 'request_id': 'req-d139b697-51aa-4bb2-ac21-aeacad555091'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.617158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:52.622213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6700b35745e4290b820f91719b249d4', 'request_id': 'req-d139b697-51aa-4bb2-ac21-aeacad555091'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.628543 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6700b35745e4290b820f91719b249d4', 'request_id': 'req-d139b697-51aa-4bb2-ac21-aeacad555091'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.641338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] The token cache is being invalidate because project d6700b35745e4290b820f91719b249d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:52.641634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.642273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d139b697-51aa-4bb2-ac21-aeacad555091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:52.643822 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1321/2657] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:52 2022] DELETE /identity/v3/projects/d6700b35745e4290b820f91719b249d4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:52.649843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.650128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.650423 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.668949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:52.670199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:52.729303 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1337/2658] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:52.737238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.737526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.737805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.756133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:52.757366 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:52.765876 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1322/2659] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:54:52.769974 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.780530 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45a5f5-0e77-404b-b461-9f28f2165109 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:52.785359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:52.786104 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.786358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.786637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.787366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:54:52.787853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:52.789498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:52.801831 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1338/2660] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:54:52.806116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.815681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5eff3-3b46-4207-9228-19ccd803fe75 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:52.820501 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:52.821163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.821454 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.821731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.822416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:52.825017 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:52.850244 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1323/2661] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:52 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:52.854597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.865157 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304c26-f17c-4a4b-8d3f-162ba005e710 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:52.922377 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:52.923041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.923324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.923600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.924289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:52.926268 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:52.932837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:52.950233 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1339/2662] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:52 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:54:52.954500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.965756 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd93cc-1943-4634-9b99-31c7ccf1f028 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:52.970297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:52.970947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:52.971226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:52.971497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:52.972214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:52.973869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:52.984985 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1324/2663] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:52.988723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:52.998973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcaa1-2e19-4f4d-bb07-68acef8299d5 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:53.003563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11323e-7fff-4352-a359-1d99b8cf602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:53.004210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11323e-7fff-4352-a359-1d99b8cf602e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:53.004493 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11323e-7fff-4352-a359-1d99b8cf602e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:53.004799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11323e-7fff-4352-a359-1d99b8cf602e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:53.005544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11323e-7fff-4352-a359-1d99b8cf602e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:53.007152 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11323e-7fff-4352-a359-1d99b8cf602e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:53.016940 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1340/2664] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:54:53.020932 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:53.031330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ec12-f9ff-4286-b7bb-5800b713b181 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:53.035995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:53.036856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:53.037159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:53.037441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] PATH_INFO: `/v3/projects/efb2264d1da04ebb993d51af25a79154/users/64ec07c3e34641608e34ac1515114dad/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:53.053960 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb2264d1da04ebb993d51af25a79154, user_id=64ec07c3e34641608e34ac1515114dad, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:53.056592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:53.069932 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1325/2665] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:53 2022] PUT /identity/v3/projects/efb2264d1da04ebb993d51af25a79154/users/64ec07c3e34641608e34ac1515114dad/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:53.080906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:53.081255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:53.081539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:53.109085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] MFA Rules not processed for user `64ec07c3e34641608e34ac1515114dad`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:53.110328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:53.174276 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1341/2666] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:53.185307 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:53.187084 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:53.274649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e710e-adf5-417b-abf6-7b2c23a3ef2a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:53.281982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54692f-32f6-4b04-9f32-bdd6e4a6cc1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:53.282548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54692f-32f6-4b04-9f32-bdd6e4a6cc1a service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:53.282834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54692f-32f6-4b04-9f32-bdd6e4a6cc1a service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:53.283115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54692f-32f6-4b04-9f32-bdd6e4a6cc1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:53.291864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54692f-32f6-4b04-9f32-bdd6e4a6cc1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:53.294340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54692f-32f6-4b04-9f32-bdd6e4a6cc1a service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:53.304299 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1326/2667] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:54:58.503408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:58.564131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9bd4-b10c-4393-8c8f-6111c3e80d75 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:58.568539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:58.569431 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:58.569707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:58.569978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] PATH_INFO: `/v3/users/64ec07c3e34641608e34ac1515114dad` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:58.571143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ec07c3e34641608e34ac1515114dad)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:58.573055 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:58.619865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ec07c3e34641608e34ac1515114dad'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:58.627570 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ec07c3e34641608e34ac1515114dad'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:58.628219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ec07c3e34641608e34ac1515114dad'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:58.634804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ec07c3e34641608e34ac1515114dad'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:58.635438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ec07c3e34641608e34ac1515114dad'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:58.641075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:58.655088 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1342/2668] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:54:58 2022] DELETE /identity/v3/users/64ec07c3e34641608e34ac1515114dad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:58.659774 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:58.660248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:58.660347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:58.677736 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:58.678930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:58.737342 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1327/2669] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:58.747191 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:58.748656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:58.805364 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0f77c-3ab4-4288-9517-4b8a81f3017d admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:58.809004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff0b38-6f3f-4139-b9bf-15282ab16f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:58.809668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff0b38-6f3f-4139-b9bf-15282ab16f9f service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:58.809951 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff0b38-6f3f-4139-b9bf-15282ab16f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:58.810229 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff0b38-6f3f-4139-b9bf-15282ab16f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:58.819180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff0b38-6f3f-4139-b9bf-15282ab16f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:58.820605 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff0b38-6f3f-4139-b9bf-15282ab16f9f service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:58.830615 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1343/2670] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:54:59.103315 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.104769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:59.112985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:59.121924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa3950-c381-4c59-9c40-a74226002911 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.127713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.128934 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.129102 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.129453 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] PATH_INFO: `/v3/projects/efb2264d1da04ebb993d51af25a79154` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.130844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb2264d1da04ebb993d51af25a79154)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.132770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.180854 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb2264d1da04ebb993d51af25a79154', 'request_id': 'req-8da3fde0-dcf7-413b-8de9-62764a7166e8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:59.187489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb2264d1da04ebb993d51af25a79154', 'request_id': 'req-8da3fde0-dcf7-413b-8de9-62764a7166e8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:59.193041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb2264d1da04ebb993d51af25a79154', 'request_id': 'req-8da3fde0-dcf7-413b-8de9-62764a7166e8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:59.206072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] The token cache is being invalidate because project efb2264d1da04ebb993d51af25a79154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:54:59.206357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:59.207231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-8da3fde0-dcf7-413b-8de9-62764a7166e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:54:59.208766 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1328/2671] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:54:59 2022] DELETE /identity/v3/projects/efb2264d1da04ebb993d51af25a79154 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:59.213942 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.214236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.214556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.232110 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:59.233353 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:59.292195 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1344/2672] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:59.299881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.300168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.300457 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.319250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:59.320442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:59.329161 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1329/2673] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:59.333284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.343690 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f7c80-c4ac-4b85-8d91-a4956bd9c303 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.348396 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.349049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.349358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.349634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.350349 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:54:59.350679 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.352539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.364788 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1345/2674] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:54:59.368991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.379417 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216541b0-f763-4893-9707-94cef96d9fb4 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.384132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.384776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.385056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.385361 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.386052 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.388153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.414004 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1330/2675] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:54:59.418884 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.429523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ddbb8-5d69-4c13-a9a1-98561d2109d1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.485390 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.486048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.486324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.486599 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.487271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.489194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.508377 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1346/2676] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:54:59.512723 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.523403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd063c-da7b-4299-9e2b-fd0e99688319 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.528193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.528853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.529164 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.529438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.530157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.531746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.542110 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1331/2677] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:59.546863 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.556603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3ec70-a807-4cd9-a639-f2fdcc85a8c1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.561718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eae3c-a7c4-4507-b30f-a24137ac8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.562358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eae3c-a7c4-4507-b30f-a24137ac8269 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.562763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eae3c-a7c4-4507-b30f-a24137ac8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.563034 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eae3c-a7c4-4507-b30f-a24137ac8269 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.563741 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eae3c-a7c4-4507-b30f-a24137ac8269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.565347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eae3c-a7c4-4507-b30f-a24137ac8269 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.566590 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:59.578316 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1347/2678] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:59.582234 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.592389 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca94c9f-6554-416b-8313-6e6b9d06638c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.597358 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.598219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.598508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.598777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] PATH_INFO: `/v3/projects/027ac12c914141e89bb1f96bbb0541c6/users/3e8db1125c204f8c81c83adb4776873d/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.614134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027ac12c914141e89bb1f96bbb0541c6, user_id=3e8db1125c204f8c81c83adb4776873d, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.616789 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.630981 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1332/2679] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:59 2022] PUT /identity/v3/projects/027ac12c914141e89bb1f96bbb0541c6/users/3e8db1125c204f8c81c83adb4776873d/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:54:59.642610 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.642901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.643181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.669580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] MFA Rules not processed for user `3e8db1125c204f8c81c83adb4776873d`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:54:59.670796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:54:59.736935 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1348/2680] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:54:59.741442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.803204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0072ed-ad51-4f61-9152-9ec77224f4f1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.807812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.808558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.808841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.809163 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.809848 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.811745 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.836528 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1333/2681] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:59.841286 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.852074 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96609ea-2d95-413a-be4c-0db85f2f1306 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.908727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.910270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.910270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.910270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.910660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.912587 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.936102 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1349/2682] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:54:59 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:54:59.940153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.950692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec9f8-3b7a-45f9-b5a1-bb0ec0354d1f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.955236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.955882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.956165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.956441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:54:59.957223 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:54:59.958802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:54:59.960072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:59.974045 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1334/2683] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:54:59.978135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:54:59.988907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e11cd-010a-484e-9669-05dcf1620fd5 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:54:59.993385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:54:59.994255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:54:59.994536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:54:59.994813 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] PATH_INFO: `/v3/projects/033fae5caefa4cb391a43c72a71a8f3f/users/5280c0740c864fe393f5a33a23445c77/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.009436 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033fae5caefa4cb391a43c72a71a8f3f, user_id=5280c0740c864fe393f5a33a23445c77, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:00.012107 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:00.024610 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1350/2684] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:54:59 2022] PUT /identity/v3/projects/033fae5caefa4cb391a43c72a71a8f3f/users/5280c0740c864fe393f5a33a23445c77/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:00.029004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:00.038958 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eea91a-44a6-492d-8f08-13bc10dc8730 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:00.096150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf76af-efb9-4438-9668-66b9f29b91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:00.096812 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf76af-efb9-4438-9668-66b9f29b91a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.097097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf76af-efb9-4438-9668-66b9f29b91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.097411 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf76af-efb9-4438-9668-66b9f29b91a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.098125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf76af-efb9-4438-9668-66b9f29b91a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:00.099711 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf76af-efb9-4438-9668-66b9f29b91a3 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:00.109373 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1335/2685] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:00.113504 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:00.123791 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13aa9-9d57-446b-814a-61a0911c44e6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:00.128470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:00.129374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.129659 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.129936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] PATH_INFO: `/v3/projects/033fae5caefa4cb391a43c72a71a8f3f/users/5280c0740c864fe393f5a33a23445c77/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.131895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033fae5caefa4cb391a43c72a71a8f3f, user_id=5280c0740c864fe393f5a33a23445c77, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:00.134603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:00.145473 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1351/2686] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:00 2022] PUT /identity/v3/projects/033fae5caefa4cb391a43c72a71a8f3f/users/5280c0740c864fe393f5a33a23445c77/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:00.156120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.156414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.156693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.182270 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] MFA Rules not processed for user `5280c0740c864fe393f5a33a23445c77`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:00.184021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:00.252941 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1336/2687] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:00.264115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:00.265944 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:00.309176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:00.325901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24bfb-2d7d-44ef-869e-76eba55c3e14 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:00.329545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458a8bd-7016-4498-a92d-9cf5e0c40bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:00.330189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458a8bd-7016-4498-a92d-9cf5e0c40bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.330469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458a8bd-7016-4498-a92d-9cf5e0c40bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.330744 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458a8bd-7016-4498-a92d-9cf5e0c40bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.340382 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458a8bd-7016-4498-a92d-9cf5e0c40bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:00.341859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458a8bd-7016-4498-a92d-9cf5e0c40bd1 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:00.351466 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1352/2688] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:00.486183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:00.550182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3ca9f-adc4-4676-ace2-de4e89eb40fb None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:00.554788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:00.555654 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.555941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.556221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] PATH_INFO: `/v3/users/3e8db1125c204f8c81c83adb4776873d` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.557579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8db1125c204f8c81c83adb4776873d)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:00.559940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:00.583709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:00.613401 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8db1125c204f8c81c83adb4776873d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:00.621626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8db1125c204f8c81c83adb4776873d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:00.622368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8db1125c204f8c81c83adb4776873d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:00.634990 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8db1125c204f8c81c83adb4776873d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:00.643263 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8db1125c204f8c81c83adb4776873d'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:00.649354 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1337/2689] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:00 2022] DELETE /identity/v3/users/3e8db1125c204f8c81c83adb4776873d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:00.655356 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.655870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.655969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.675332 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:00.676549 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:00.741704 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1353/2690] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:00.752141 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:00.753602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:00.816092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cd19a-a4d6-46b3-8a02-bbef2cc54fc4 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:00.820251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:00.820905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:00.821214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:00.821495 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:00.832096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:00.834175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:00.850277 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1338/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:01.147435 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:01.148928 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:01.166756 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83054910-de76-4d5c-8bbb-ad55532ee6e7 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:01.171676 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:01.172543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:01.172826 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:01.173109 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] PATH_INFO: `/v3/projects/027ac12c914141e89bb1f96bbb0541c6` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:01.174331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=027ac12c914141e89bb1f96bbb0541c6)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:01.176272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:01.226498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027ac12c914141e89bb1f96bbb0541c6', 'request_id': 'req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.232113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027ac12c914141e89bb1f96bbb0541c6', 'request_id': 'req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.238503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027ac12c914141e89bb1f96bbb0541c6', 'request_id': 'req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.252030 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] The token cache is being invalidate because project 027ac12c914141e89bb1f96bbb0541c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:01.252316 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.252937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.254776 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1354/2692] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:01 2022] DELETE /identity/v3/projects/027ac12c914141e89bb1f96bbb0541c6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:55:01.258809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:01.269297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc786-51bb-4582-826e-a205606e1e4d service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:01.331931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:01.332823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:01.333209 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:01.333412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] PATH_INFO: `/v3/users/5280c0740c864fe393f5a33a23445c77` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:01.335498 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5280c0740c864fe393f5a33a23445c77)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:01.337018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:01.380892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:01.387395 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5280c0740c864fe393f5a33a23445c77'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.395191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5280c0740c864fe393f5a33a23445c77'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.395957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5280c0740c864fe393f5a33a23445c77'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.407743 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5280c0740c864fe393f5a33a23445c77'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.415341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-ee8bd713-1593-4bf3-a1ed-4fe804d15fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5280c0740c864fe393f5a33a23445c77'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.422596 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1339/2693] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:01 2022] DELETE /identity/v3/users/5280c0740c864fe393f5a33a23445c77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:01.697270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:01.698803 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:01.712083 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bd9e0-914c-424c-a7d3-c20b0bf925dc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:01.771544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:01.772404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:01.772685 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:01.772964 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] PATH_INFO: `/v3/projects/033fae5caefa4cb391a43c72a71a8f3f` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:01.774178 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033fae5caefa4cb391a43c72a71a8f3f)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:01.776127 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:01.783207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:01.823216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033fae5caefa4cb391a43c72a71a8f3f', 'request_id': 'req-5845be2c-f07b-46e4-92f6-74209417f7a3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.829503 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033fae5caefa4cb391a43c72a71a8f3f', 'request_id': 'req-5845be2c-f07b-46e4-92f6-74209417f7a3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.835789 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033fae5caefa4cb391a43c72a71a8f3f', 'request_id': 'req-5845be2c-f07b-46e4-92f6-74209417f7a3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.848554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] The token cache is being invalidate because project 033fae5caefa4cb391a43c72a71a8f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:01.848842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.849470 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-5845be2c-f07b-46e4-92f6-74209417f7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:01.851002 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1355/2694] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:01 2022] DELETE /identity/v3/projects/033fae5caefa4cb391a43c72a71a8f3f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:01.856869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:01.857387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:01.857515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:01.875338 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:01.876585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:01.937499 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1340/2695] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:55:01.945337 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933be9-d816-437b-b758-443f81435475 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:01.945630 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933be9-d816-437b-b758-443f81435475 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:01.945936 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933be9-d816-437b-b758-443f81435475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:01.965554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8c933be9-d816-437b-b758-443f81435475 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:01.966758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8c933be9-d816-437b-b758-443f81435475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:01.974964 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1356/2696] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:01.979206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:01.990335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c85e2-1972-4d9b-a9bd-5fbe17aa0755 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:01.994888 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:01.996094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:01.996558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:01.996841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:01.997602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:55:01.997914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:01.999502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.011753 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1341/2697] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:55:02.016169 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933be9-d816-437b-b758-443f81435475 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.025526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933be9-d816-437b-b758-443f81435475 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.030341 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.030983 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.031265 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.031542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.032232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.034214 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.067956 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1357/2698] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:02 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:02.072055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.082688 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48da1-780a-4268-b4c0-1c83c68e6ff6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.139229 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.139898 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.140182 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.140461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.141186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.143105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.163059 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1342/2699] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:02 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:02.167335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.178284 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3527e-eb89-4bec-a858-dbfa877fa6e5 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.182835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.183618 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.183890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.184177 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.184872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.186496 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.196703 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1358/2700] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:02.200796 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.211150 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1240-b3e5-476d-979b-1a98d8b893fe admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.216715 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20631b2b-017b-4c8c-86df-b19be7da9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.217560 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20631b2b-017b-4c8c-86df-b19be7da9a71 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.217823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20631b2b-017b-4c8c-86df-b19be7da9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.218154 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20631b2b-017b-4c8c-86df-b19be7da9a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.219003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20631b2b-017b-4c8c-86df-b19be7da9a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.220959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20631b2b-017b-4c8c-86df-b19be7da9a71 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.232429 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1343/2701] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:55:02.236835 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.247072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b67e78-a918-44c0-bf33-a990a3868b8e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.251573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.252430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.252802 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.253079 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] PATH_INFO: `/v3/projects/e9f0f8baec5040b8b62d3466d52df129/users/44087e116b8d4b5ba6703006e33061d3/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.267608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f0f8baec5040b8b62d3466d52df129, user_id=44087e116b8d4b5ba6703006e33061d3, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.270306 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.284007 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1359/2702] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:02 2022] PUT /identity/v3/projects/e9f0f8baec5040b8b62d3466d52df129/users/44087e116b8d4b5ba6703006e33061d3/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:02.296235 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.296535 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.296821 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.322930 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] MFA Rules not processed for user `44087e116b8d4b5ba6703006e33061d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:02.324778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:02.337369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:02.397564 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1344/2703] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:02.402691 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.466046 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74337fa-2ce3-4128-9c84-95e54f98a2b2 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.470657 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.471312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.471593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.471865 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.472538 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.474475 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.508248 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1360/2704] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:02 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:02.512835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.523691 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb9ef-919f-4453-8b06-44c7e65e1b5f None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.579914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.580569 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.580850 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.581127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.581833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.583753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.604091 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1345/2705] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:02 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:02.608330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.618750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c147b-6647-4be1-8fa0-a07ded5839a1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.623714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.624363 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.624641 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.624914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.625663 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.627318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.638641 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1361/2706] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:02.642985 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.653359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ecf41-0500-4b3c-8429-b8960f736d5c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.658041 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.658914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.659197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.659493 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] PATH_INFO: `/v3/projects/693cbf2f326342b9acc19e8a45204340/users/d57ccde282134f1086982a6262274ac7/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.674197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] RBAC: Authorizing `identity:create_grant(project_id=693cbf2f326342b9acc19e8a45204340, user_id=d57ccde282134f1086982a6262274ac7, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.676833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.690249 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1346/2707] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:02 2022] PUT /identity/v3/projects/693cbf2f326342b9acc19e8a45204340/users/d57ccde282134f1086982a6262274ac7/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:02.694289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.701253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:02.705011 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b29ac-2952-437a-a045-cff1eb6f756c admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.762996 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8682d5-31b4-4f0b-8628-f07d2a9c0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.763573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8682d5-31b4-4f0b-8628-f07d2a9c0c52 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.763852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8682d5-31b4-4f0b-8628-f07d2a9c0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.764126 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8682d5-31b4-4f0b-8628-f07d2a9c0c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.764832 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8682d5-31b4-4f0b-8628-f07d2a9c0c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.766477 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8682d5-31b4-4f0b-8628-f07d2a9c0c52 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.775964 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1362/2708] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:02.780133 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.790746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6a20-c85a-4964-80fc-2dfdbd6b191f admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.796170 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.797064 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.797374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.797655 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] PATH_INFO: `/v3/projects/693cbf2f326342b9acc19e8a45204340/users/d57ccde282134f1086982a6262274ac7/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.799643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693cbf2f326342b9acc19e8a45204340, user_id=d57ccde282134f1086982a6262274ac7, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:02.802339 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:02.813287 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1347/2709] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:02 2022] PUT /identity/v3/projects/693cbf2f326342b9acc19e8a45204340/users/d57ccde282134f1086982a6262274ac7/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:02.823303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.823621 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.824509 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:02.851045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] MFA Rules not processed for user `d57ccde282134f1086982a6262274ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:02.852242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:02.919706 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1363/2710] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:02.930168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:02.931923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:02.988862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a127d-b936-4ed0-a58e-e04a12077171 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:02.992506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3c5fd-8917-48aa-a4ba-6bb3a5eeb30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:02.993159 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3c5fd-8917-48aa-a4ba-6bb3a5eeb30f service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:02.993450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3c5fd-8917-48aa-a4ba-6bb3a5eeb30f service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:02.993754 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3c5fd-8917-48aa-a4ba-6bb3a5eeb30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:03.004914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3c5fd-8917-48aa-a4ba-6bb3a5eeb30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:03.006387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3c5fd-8917-48aa-a4ba-6bb3a5eeb30f service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:03.016355 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1348/2711] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:03.143737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:03.203906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34d16e-d9f8-4819-9db3-f6c951fa24e2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:03.208309 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:03.209243 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:03.209541 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:03.209797 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] PATH_INFO: `/v3/users/44087e116b8d4b5ba6703006e33061d3` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:03.211213 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44087e116b8d4b5ba6703006e33061d3)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:03.213164 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:03.244828 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:03.263935 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44087e116b8d4b5ba6703006e33061d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.271111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44087e116b8d4b5ba6703006e33061d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.271767 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44087e116b8d4b5ba6703006e33061d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.279583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44087e116b8d4b5ba6703006e33061d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.280215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44087e116b8d4b5ba6703006e33061d3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.297271 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1364/2712] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:03 2022] DELETE /identity/v3/users/44087e116b8d4b5ba6703006e33061d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:03.301693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:03.301987 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:03.302284 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:03.320663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:03.321896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:03.326931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:03.392633 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1349/2713] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:03.403153 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:03.404555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:03.469736 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9fac-eed7-4587-bed5-f840b4bc9232 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:03.473330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:03.473967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:03.474245 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:03.474516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:03.483859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:03.485324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:03.497540 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1365/2714] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:03.765539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:03.766959 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:03.780992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ec110-c14d-4ecc-838c-e59f82b002b7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:03.786387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:03.787517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:03.787707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:03.788202 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] PATH_INFO: `/v3/projects/e9f0f8baec5040b8b62d3466d52df129` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:03.789208 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f0f8baec5040b8b62d3466d52df129)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:03.791144 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:03.839300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f0f8baec5040b8b62d3466d52df129', 'request_id': 'req-568d7dd1-7341-43ae-b527-44435431afdd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.845530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f0f8baec5040b8b62d3466d52df129', 'request_id': 'req-568d7dd1-7341-43ae-b527-44435431afdd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.851115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f0f8baec5040b8b62d3466d52df129', 'request_id': 'req-568d7dd1-7341-43ae-b527-44435431afdd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.863324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] The token cache is being invalidate because project e9f0f8baec5040b8b62d3466d52df129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:03.863617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.864243 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.865832 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1350/2715] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:03 2022] DELETE /identity/v3/projects/e9f0f8baec5040b8b62d3466d52df129 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:03.869792 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:03.880531 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a612b9-250e-4937-b965-9883e8a6edb1 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:03.938706 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:03.939578 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:03.939860 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:03.940134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] PATH_INFO: `/v3/users/d57ccde282134f1086982a6262274ac7` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:03.941385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57ccde282134f1086982a6262274ac7)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:03.943330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:03.988631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57ccde282134f1086982a6262274ac7'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.990635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:03.997764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57ccde282134f1086982a6262274ac7'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:03.998527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57ccde282134f1086982a6262274ac7'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.006228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57ccde282134f1086982a6262274ac7'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.006997 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-60c1014f-cad6-47f3-b620-2cefc96e03d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57ccde282134f1086982a6262274ac7'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.024330 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1366/2716] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:03 2022] DELETE /identity/v3/users/d57ccde282134f1086982a6262274ac7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:04.297231 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.298801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:04.312292 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d7dd1-7341-43ae-b527-44435431afdd admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.374310 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.375097 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.375380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.375653 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] PATH_INFO: `/v3/projects/693cbf2f326342b9acc19e8a45204340` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.376838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=693cbf2f326342b9acc19e8a45204340)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.378776 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.415778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:04.426852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693cbf2f326342b9acc19e8a45204340', 'request_id': 'req-43303320-22fd-413f-9117-f7c64c44b711'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.433195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693cbf2f326342b9acc19e8a45204340', 'request_id': 'req-43303320-22fd-413f-9117-f7c64c44b711'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.438788 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693cbf2f326342b9acc19e8a45204340', 'request_id': 'req-43303320-22fd-413f-9117-f7c64c44b711'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.450704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] The token cache is being invalidate because project 693cbf2f326342b9acc19e8a45204340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:04.450992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.451621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-43303320-22fd-413f-9117-f7c64c44b711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:04.453413 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1351/2717] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:04 2022] DELETE /identity/v3/projects/693cbf2f326342b9acc19e8a45204340 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:04.458097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.458388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.458666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.477930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:04.479120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:04.539504 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1367/2718] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:04.548090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.548386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.548665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.566993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:04.568195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:04.576841 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1352/2719] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:04.580880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.591456 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbef6-5884-4889-bd68-880e5cc9a77e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.595988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.596638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.596921 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.597232 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.597952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:55:04.598261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.599866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.611215 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1368/2720] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:55:04.615438 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.624681 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff766b34-732c-439f-afb0-72a0d9e58c3e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.629132 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.629798 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.630077 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.630349 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.631090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.632964 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.658480 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1353/2721] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:04 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:04.662600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.672846 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fefa40-1242-41f2-aced-46efb12c27e7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.729816 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.730546 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.730859 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.731141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.731842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.733806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.755711 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1369/2722] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:04 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:04.756975 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.767728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493d8e-8d00-4b8a-b290-8ae8b0a2e851 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.772290 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.772940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.773269 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.773550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.774268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.775862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.787045 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1354/2723] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:04.790916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.800754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabce070-459d-4760-a45b-8d796e52efa8 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.805339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214579-7c36-4db1-abbf-715492b0cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.805989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214579-7c36-4db1-abbf-715492b0cd6f admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.806274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214579-7c36-4db1-abbf-715492b0cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.806554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214579-7c36-4db1-abbf-715492b0cd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.807270 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15214579-7c36-4db1-abbf-715492b0cd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.808896 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15214579-7c36-4db1-abbf-715492b0cd6f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.818713 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1370/2724] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:04.822669 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.833165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f786-0f69-4a1b-82fb-5c4532dfc604 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:04.837980 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:04.838957 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.839248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.839572 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] PATH_INFO: `/v3/projects/dfe5516f401349c580dd0bc936707163/users/aa14d137509240b589501ec509734ae9/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.854200 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5516f401349c580dd0bc936707163, user_id=aa14d137509240b589501ec509734ae9, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:04.857517 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:04.870224 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1355/2725] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:04 2022] PUT /identity/v3/projects/dfe5516f401349c580dd0bc936707163/users/aa14d137509240b589501ec509734ae9/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:04.882054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:04.882550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:04.882550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:04.910511 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] MFA Rules not processed for user `aa14d137509240b589501ec509734ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:04.911728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:04.932103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:04.978924 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1371/2726] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:55:04.990835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:04.992537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:05.049696 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f72f9-d42d-400b-b06b-7b8e75438615 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:05.053331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b101ca-dd8b-48b1-be4f-284dca7f3692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:05.053973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b101ca-dd8b-48b1-be4f-284dca7f3692 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:05.054256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b101ca-dd8b-48b1-be4f-284dca7f3692 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:05.054537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b101ca-dd8b-48b1-be4f-284dca7f3692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:05.062869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b101ca-dd8b-48b1-be4f-284dca7f3692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:05.064302 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b101ca-dd8b-48b1-be4f-284dca7f3692 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:05.072982 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1356/2727] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:05.092638 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:05.163112 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3f3a7-1391-4f77-8faa-b1acafddc5b3 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:05.169278 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:05.170148 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:05.170430 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:05.170708 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] PATH_INFO: `/v3/users/aa14d137509240b589501ec509734ae9` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:05.171906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa14d137509240b589501ec509734ae9)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:05.173875 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:05.219544 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa14d137509240b589501ec509734ae9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:05.227190 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa14d137509240b589501ec509734ae9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:05.227895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa14d137509240b589501ec509734ae9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:05.242186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa14d137509240b589501ec509734ae9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:05.242824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa14d137509240b589501ec509734ae9'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:05.260272 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1372/2728] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:05 2022] DELETE /identity/v3/users/aa14d137509240b589501ec509734ae9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:55:05.265043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:05.265374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:05.265660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:05.283143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:05.284341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:05.346189 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1357/2729] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:05.355593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:05.357005 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:05.403424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:05.416678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf5a1-6a5f-41c8-acca-27b15590fb4c admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:05.420551 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e241dc4-ea6a-4fdb-9c7d-57d94d390495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:05.421228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e241dc4-ea6a-4fdb-9c7d-57d94d390495 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:05.421517 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e241dc4-ea6a-4fdb-9c7d-57d94d390495 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:05.421796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e241dc4-ea6a-4fdb-9c7d-57d94d390495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:05.430988 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e241dc4-ea6a-4fdb-9c7d-57d94d390495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:05.432434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e241dc4-ea6a-4fdb-9c7d-57d94d390495 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:05.442291 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1373/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:05.959430 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:05.961189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:05.968228 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:05.975694 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29962c0-6cd6-47f3-92b0-a10115f2ab2b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:05.982316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:05.983197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:05.983480 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:05.983760 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] PATH_INFO: `/v3/projects/dfe5516f401349c580dd0bc936707163` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:05.985008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe5516f401349c580dd0bc936707163)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:05.986998 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.035539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe5516f401349c580dd0bc936707163', 'request_id': 'req-17a2190f-ea0d-4394-84b6-7989f439f2b7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.041860 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe5516f401349c580dd0bc936707163', 'request_id': 'req-17a2190f-ea0d-4394-84b6-7989f439f2b7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.047550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe5516f401349c580dd0bc936707163', 'request_id': 'req-17a2190f-ea0d-4394-84b6-7989f439f2b7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.061265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] The token cache is being invalidate because project dfe5516f401349c580dd0bc936707163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:06.061561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.062188 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-17a2190f-ea0d-4394-84b6-7989f439f2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.063772 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1358/2731] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:05 2022] DELETE /identity/v3/projects/dfe5516f401349c580dd0bc936707163 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:06.068688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.069220 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.069335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.087522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:06.088722 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:06.148498 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1374/2732] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:06.157121 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.157461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.157747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.176616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:06.177859 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:06.186469 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1359/2733] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:06.190680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.200714 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9f82-ab16-4b0a-8d2d-5c7909e7ea51 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.205203 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.205848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.206124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.206394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.207103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:55:06.207408 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.208998 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.222163 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1375/2734] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:55:06.226449 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.236580 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ebcd1-ebde-44af-a550-901acb023fc0 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.241172 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.241882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.242165 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.242440 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.243164 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.245037 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.271090 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1360/2735] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:06 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:06.275130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.285534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6a36-401f-482d-b1c5-84451e77ecf6 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.343215 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.344008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.344292 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.344572 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.345303 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.347299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.368949 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1376/2736] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:06 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:06.374055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.384262 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e04d-ff52-4526-a3bb-2a43fcfd5cdc admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.389078 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.389768 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.390056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.390334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.391059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.392687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.404377 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1361/2737] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:06.408217 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.418701 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec72009-55f7-4447-b5fe-e4476739ed5c admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.423277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac516-2802-41d1-8359-9a463bc58351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.423925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac516-2802-41d1-8359-9a463bc58351 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.424210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac516-2802-41d1-8359-9a463bc58351 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.424495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac516-2802-41d1-8359-9a463bc58351 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.425249 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac516-2802-41d1-8359-9a463bc58351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.426853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac516-2802-41d1-8359-9a463bc58351 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.437337 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1377/2738] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:06.441399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.451285 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456da3c-1e05-4e3d-a2c3-a0223571aa98 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.455889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.456750 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.457034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.457344 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] PATH_INFO: `/v3/projects/8d18357d76bc4598b96a99c8f44a8b5b/users/ce7f80fe2f2f41529c97bc59ccaf9b34/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.472570 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d18357d76bc4598b96a99c8f44a8b5b, user_id=ce7f80fe2f2f41529c97bc59ccaf9b34, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.475179 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.489624 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1362/2739] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:06 2022] PUT /identity/v3/projects/8d18357d76bc4598b96a99c8f44a8b5b/users/ce7f80fe2f2f41529c97bc59ccaf9b34/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:06.499965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.500253 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.500603 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.534901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] MFA Rules not processed for user `ce7f80fe2f2f41529c97bc59ccaf9b34`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:06.536144 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:06.575321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:06.599966 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1378/2740] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:06.611662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.613394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:06.670043 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3245-3b55-41c7-86d6-b4edb20a10fa admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.673785 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddda9c-ad0f-460b-bbfb-31cde518526f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.674424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddda9c-ad0f-460b-bbfb-31cde518526f service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.674704 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddda9c-ad0f-460b-bbfb-31cde518526f service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.674981 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddda9c-ad0f-460b-bbfb-31cde518526f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.683217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddda9c-ad0f-460b-bbfb-31cde518526f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.684701 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddda9c-ad0f-460b-bbfb-31cde518526f service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.693426 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1363/2741] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:06.718211 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.779945 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8feb1e-bfd2-4c1f-b204-482ec706affb None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:06.784418 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:06.785334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.785620 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.785909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] PATH_INFO: `/v3/users/ce7f80fe2f2f41529c97bc59ccaf9b34` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.787146 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7f80fe2f2f41529c97bc59ccaf9b34)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:06.789063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:06.835611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7f80fe2f2f41529c97bc59ccaf9b34'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.843361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7f80fe2f2f41529c97bc59ccaf9b34'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.844024 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7f80fe2f2f41529c97bc59ccaf9b34'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.851297 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7f80fe2f2f41529c97bc59ccaf9b34'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.852063 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7f80fe2f2f41529c97bc59ccaf9b34'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:06.869258 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1379/2742] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:06 2022] DELETE /identity/v3/users/ce7f80fe2f2f41529c97bc59ccaf9b34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:06.873847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:06.874142 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:06.874425 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:06.891753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:06.892940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:06.912433 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:06.958616 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1364/2743] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:06.965985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:06.967434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:07.024952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e5f20-3dd3-4f26-9438-1db25949f1a2 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.029318 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57d85-3b57-41c9-b0e9-24999f7609ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.030009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57d85-3b57-41c9-b0e9-24999f7609ae service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.030236 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57d85-3b57-41c9-b0e9-24999f7609ae service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.030508 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57d85-3b57-41c9-b0e9-24999f7609ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.039993 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae57d85-3b57-41c9-b0e9-24999f7609ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.041465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae57d85-3b57-41c9-b0e9-24999f7609ae service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.052829 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1380/2744] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:07.317873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.319414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:07.336518 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dd356-69f1-48ce-8cb1-68d527c10a9a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.342071 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.343039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.343418 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.343771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] PATH_INFO: `/v3/projects/8d18357d76bc4598b96a99c8f44a8b5b` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.345056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d18357d76bc4598b96a99c8f44a8b5b)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.347011 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.394173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d18357d76bc4598b96a99c8f44a8b5b', 'request_id': 'req-f8079b75-beb0-467b-833f-6f1d28e97dcf'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:07.400330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d18357d76bc4598b96a99c8f44a8b5b', 'request_id': 'req-f8079b75-beb0-467b-833f-6f1d28e97dcf'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:07.406539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d18357d76bc4598b96a99c8f44a8b5b', 'request_id': 'req-f8079b75-beb0-467b-833f-6f1d28e97dcf'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:07.418687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] The token cache is being invalidate because project 8d18357d76bc4598b96a99c8f44a8b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:07.418970 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:07.419582 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-f8079b75-beb0-467b-833f-6f1d28e97dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:07.421221 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1365/2745] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:07 2022] DELETE /identity/v3/projects/8d18357d76bc4598b96a99c8f44a8b5b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:07.426131 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.426629 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.426817 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.433949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:07.447869 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:07.449739 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:07.508169 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1381/2746] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:55:07.517844 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.518191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.518475 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.537367 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:07.538576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:07.547164 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1366/2747] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:07.551279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.561105 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664083-b215-4aa1-a011-c53b6064f4d9 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.565662 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.566311 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.566595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.566874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.567589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:55:07.567899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.569553 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.581528 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1382/2748] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:55:07.585941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.596008 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d94256-6117-4c98-b44a-d2d430e8bf57 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.600600 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.601273 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.601558 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.601834 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.602510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.604416 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.629558 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1367/2749] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:07 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:07.633769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.644545 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43680-03dc-4337-8670-09aaf4a3d68b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.699348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.699984 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.700262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.700532 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.701240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.703136 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.723046 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1383/2750] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:07 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:55:07.727213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.737895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f215-3d5a-40ce-a9f2-9f565e3420be admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.742720 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.743384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.743672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.743952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.744679 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.746420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.756762 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1368/2751] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:07.760573 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.771090 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d506d6-01b6-4a13-9f38-37491b7be8c3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.775713 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da34e44-cd49-4855-a1fc-fba7cff0407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.776361 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34e44-cd49-4855-a1fc-fba7cff0407e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.777237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34e44-cd49-4855-a1fc-fba7cff0407e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.777533 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34e44-cd49-4855-a1fc-fba7cff0407e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.778234 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da34e44-cd49-4855-a1fc-fba7cff0407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.779830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da34e44-cd49-4855-a1fc-fba7cff0407e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.789630 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1384/2752] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:07.793505 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.803266 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b209da-6197-4331-b8c9-74f4b81dac6d admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:07.807879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:07.808714 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.808999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.809316 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] PATH_INFO: `/v3/projects/90e940b6a9de470ebf0d1d33d1b1d44a/users/c4a3edab48e54b468429ac9671324204/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.824162 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e940b6a9de470ebf0d1d33d1b1d44a, user_id=c4a3edab48e54b468429ac9671324204, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:07.826805 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:07.840118 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1369/2753] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:07 2022] PUT /identity/v3/projects/90e940b6a9de470ebf0d1d33d1b1d44a/users/c4a3edab48e54b468429ac9671324204/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:07.850299 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:07.850589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:07.850899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:07.876895 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] MFA Rules not processed for user `c4a3edab48e54b468429ac9671324204`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:07.878219 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:07.937491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:07.943057 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1385/2754] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:07.954073 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:07.955769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:08.002240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:08.015559 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51928c85-c76c-4f3f-8b22-31862bc813ff admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:08.019610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ed3d-b19b-474f-bf5d-43879ecc8bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:08.020258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ed3d-b19b-474f-bf5d-43879ecc8bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:08.020548 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ed3d-b19b-474f-bf5d-43879ecc8bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:08.020833 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ed3d-b19b-474f-bf5d-43879ecc8bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:08.029674 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ed3d-b19b-474f-bf5d-43879ecc8bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:08.031129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ed3d-b19b-474f-bf5d-43879ecc8bf7 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:08.039941 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1370/2755] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:17.945769 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:18.005277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:18.035861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=6 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:18.071087 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b97ef-e811-4681-a984-8f1c55005bc3 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:18.076488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:18.077391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.077678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.077959 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] PATH_INFO: `/v3/users/c4a3edab48e54b468429ac9671324204` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.079163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a3edab48e54b468429ac9671324204)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:18.081113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:18.130821 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a3edab48e54b468429ac9671324204'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.138417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a3edab48e54b468429ac9671324204'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.139145 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a3edab48e54b468429ac9671324204'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.147391 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a3edab48e54b468429ac9671324204'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.148016 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a3edab48e54b468429ac9671324204'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.166343 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1386/2756] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:55:18 2022] DELETE /identity/v3/users/c4a3edab48e54b468429ac9671324204 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:18.171114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.171408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.171685 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.188380 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:18.189646 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:18.249388 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1371/2757] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:18.259176 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:18.260589 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:18.319119 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8fb34-0029-4693-a5ea-926d9cdd39c0 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:18.322840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912779a1-dfe5-4288-b798-160cc4abdd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:18.323487 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912779a1-dfe5-4288-b798-160cc4abdd6e service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.323772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912779a1-dfe5-4288-b798-160cc4abdd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.324052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912779a1-dfe5-4288-b798-160cc4abdd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.334049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912779a1-dfe5-4288-b798-160cc4abdd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:18.335422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912779a1-dfe5-4288-b798-160cc4abdd6e service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:18.350463 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1387/2758] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:18.607662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:18.609224 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:18.621004 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60240f-9ac5-43f0-b3d2-d1e89fe6f3de None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:18.629185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:18.629185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.629185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.629185 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] PATH_INFO: `/v3/projects/90e940b6a9de470ebf0d1d33d1b1d44a` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.629896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e940b6a9de470ebf0d1d33d1b1d44a)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:18.632598 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:18.682847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e940b6a9de470ebf0d1d33d1b1d44a', 'request_id': 'req-21645f07-9a3e-4d56-ac39-2233e9e98254'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.689460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e940b6a9de470ebf0d1d33d1b1d44a', 'request_id': 'req-21645f07-9a3e-4d56-ac39-2233e9e98254'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.694852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e940b6a9de470ebf0d1d33d1b1d44a', 'request_id': 'req-21645f07-9a3e-4d56-ac39-2233e9e98254'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.708012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] The token cache is being invalidate because project 90e940b6a9de470ebf0d1d33d1b1d44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:55:18.708421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.709103 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-21645f07-9a3e-4d56-ac39-2233e9e98254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:55:18.710950 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1372/2759] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:55:18 2022] DELETE /identity/v3/projects/90e940b6a9de470ebf0d1d33d1b1d44a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:18.716598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.716892 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.717205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.735395 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:18.736598 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:18.754004 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:18.798012 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1388/2760] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:18.807412 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.807707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.807995 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.827413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:18.828618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:18.836740 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1373/2761] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:18.841904 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:18.851524 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e55e13-4cc3-47ca-baef-25857f7d1c13 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:18.856312 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:18.856949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.857271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.857628 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.858344 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:55:18.858649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:18.860239 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:18.871595 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1389/2762] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:55:18.875856 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:18.885018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24941c1-e8de-4884-8ee9-d383a9d5420e None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:18.890444 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:18.891092 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.891385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.891687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.892378 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:18.894320 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:18.920832 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1374/2763] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:18 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:18.924949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:18.934845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9984a2-b7ee-4587-8125-881e3d375a4e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:18.991731 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:18.992394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:18.992675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:18.992957 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:18.993664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:18.995580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:19.015487 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1390/2764] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:18 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:55:19.019614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:19.030009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21da8b-54ad-41d9-ba13-6dd84801a1ce admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:19.034634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:19.035309 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:19.035577 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:19.035861 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:19.036590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:19.038213 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:19.050255 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1375/2765] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:19.054135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:19.064864 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0505-793d-4e72-b095-23e6a80412b1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:19.069445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cac10-7955-4aa9-90dd-dd18663350c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:19.070097 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cac10-7955-4aa9-90dd-dd18663350c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:19.070378 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cac10-7955-4aa9-90dd-dd18663350c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:19.070656 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cac10-7955-4aa9-90dd-dd18663350c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:19.071373 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cac10-7955-4aa9-90dd-dd18663350c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:19.073235 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cac10-7955-4aa9-90dd-dd18663350c8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:19.084364 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1391/2766] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:19.088686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:19.099330 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8942-0e67-4907-b0f1-207cbf24b43c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:19.104074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:19.104943 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:19.105251 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:19.105556 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] PATH_INFO: `/v3/projects/94433bdea4e24d44a468370a418f79ad/users/3e5623694b884f8f94c38d40812563c7/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:19.120166 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94433bdea4e24d44a468370a418f79ad, user_id=3e5623694b884f8f94c38d40812563c7, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:19.123090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:19.138384 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1376/2767] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:19 2022] PUT /identity/v3/projects/94433bdea4e24d44a468370a418f79ad/users/3e5623694b884f8f94c38d40812563c7/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:19.143428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35949e2-65a3-41ae-9344-c71176c63abd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:19.143720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35949e2-65a3-41ae-9344-c71176c63abd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:19.144003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35949e2-65a3-41ae-9344-c71176c63abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:19.163438 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-d35949e2-65a3-41ae-9344-c71176c63abd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:19.164664 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d35949e2-65a3-41ae-9344-c71176c63abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:19.230911 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1392/2768] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:19.242436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:19.244125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:19.267880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:19.310357 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7573-af45-43d5-8d9c-9f7b11668674 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:19.314021 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:19.314663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:19.314947 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:19.315225 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:19.324157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:19.326403 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:19.336513 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1377/2769] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:23.658564 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:23.659128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:23.659128 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:23.704625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] MFA Rules not processed for user `3e5623694b884f8f94c38d40812563c7`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:23.706022 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:23.728914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:23.805544 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1393/2770] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:23.810464 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:23.822334 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ebe7-ff8c-4cfa-a657-6e96042f4abc service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:23.828250 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:23.829684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:23.830177 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:23.830623 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:23.831561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:23.834137 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:23.882176 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1378/2771] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:55:23 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:55:23.886147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:23.906271 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419a47-3056-4f6b-8db4-288bc180401f None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:23.980561 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:23.981665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:23.982014 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:23.982425 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:23.983124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:23.985179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:24.005772 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1394/2772] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:55:23 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:55:24.009624 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:24.020629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c358aa-04e3-4bb9-878a-ad8f7aca7fe4 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:24.025279 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:24.025938 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:24.026226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:24.026508 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:24.027310 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:24.029115 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:24.039687 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1379/2773] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:24.044224 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:24.054351 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ea78a-720b-4315-b7ec-2c017d3b8491 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:24.059665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:24.060678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:24.060920 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:24.061241 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] PATH_INFO: `/v3/projects/f8c400acbcd047b7bc2552ca0baa1a56/users/dac4daed6a68456aac947be78dd025cd/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:24.076542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c400acbcd047b7bc2552ca0baa1a56, user_id=dac4daed6a68456aac947be78dd025cd, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:24.079439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:24.092680 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1395/2774] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:24 2022] PUT /identity/v3/projects/f8c400acbcd047b7bc2552ca0baa1a56/users/dac4daed6a68456aac947be78dd025cd/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:24.096843 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:24.107369 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39226c-7d63-4816-9f8f-b6bf439469eb admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:24.164746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ec51-e7cb-42b5-bed6-21a98446c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:24.165426 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ec51-e7cb-42b5-bed6-21a98446c68c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:24.165713 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ec51-e7cb-42b5-bed6-21a98446c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:24.165992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ec51-e7cb-42b5-bed6-21a98446c68c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:24.166718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648ec51-e7cb-42b5-bed6-21a98446c68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:24.168492 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648ec51-e7cb-42b5-bed6-21a98446c68c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:24.178615 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1380/2775] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:55:24.182770 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:24.193577 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c26a-63f0-4d7d-bcd4-7a2a07af9dd0 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:24.198300 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:24.199745 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:24.200204 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:24.200634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] PATH_INFO: `/v3/projects/f8c400acbcd047b7bc2552ca0baa1a56/users/dac4daed6a68456aac947be78dd025cd/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:24.202678 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c400acbcd047b7bc2552ca0baa1a56, user_id=dac4daed6a68456aac947be78dd025cd, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:24.205367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:24.216805 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1396/2776] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:55:24 2022] PUT /identity/v3/projects/f8c400acbcd047b7bc2552ca0baa1a56/users/dac4daed6a68456aac947be78dd025cd/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:55:28.569576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36f280-0eee-46ba-9ed2-7b1a7398c07c None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:28.570145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36f280-0eee-46ba-9ed2-7b1a7398c07c None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:28.570145 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36f280-0eee-46ba-9ed2-7b1a7398c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:28.609385 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-3b36f280-0eee-46ba-9ed2-7b1a7398c07c None None] MFA Rules not processed for user `dac4daed6a68456aac947be78dd025cd`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:28.611012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3b36f280-0eee-46ba-9ed2-7b1a7398c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:28.707820 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1381/2777] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:28.728340 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:28.731273 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:28.843050 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9367859-81c7-45d4-bb07-17781c6dec4b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:28.851464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:28.852141 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:28.852424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:28.852699 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:28.860973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:28.919262 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:28.921006 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:28.931213 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1397/2778] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:55:29.897390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:29.897896 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:29.898538 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:29.916301 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] MFA Rules not processed for user `3e5623694b884f8f94c38d40812563c7`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:55:29.917537 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:29.924833 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1382/2779] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:55:38.926575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=24 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:39.910904 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:50.529048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:55:50.530615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:50.598930 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baa80c-2bfa-4572-806e-8da173606fd3 service nova] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:55:50.603823 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:55:50.604465 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:55:50.604749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:55:50.605026 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:55:50.606969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:55:50.618260 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:55:50.619852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be660b15-6ed8-4713-ae79-6b9c92d3fa76 service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:55:50.630385 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1398/2780] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:55:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:56:00.626314 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=32 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:02.448276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:56:02.531952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3ebc4-a9be-49a5-83a9-b1455a784295 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:56:02.535770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:56:02.536421 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:56:02.536777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:56:02.537268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:56:02.547191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:56:02.548658 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:56:02.558372 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1383/2781] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:56:06.046778 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:56:06.047289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:56:06.047426 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:56:06.064210 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] MFA Rules not processed for user `d96f7e82915f4563b05c20c414c23229`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:56:06.065468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:56:06.122293 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1399/2782] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:56:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:56:12.556892 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=26 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:16.114763 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=25 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:18.208348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:18.210122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:18.279629 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8803e0-8a9c-4fe2-bd69-42d8a16631fd service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:18.284065 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:18.284999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.285314 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.285592 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] PATH_INFO: `/v3/users/d96f7e82915f4563b05c20c414c23229` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.286771 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96f7e82915f4563b05c20c414c23229)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:18.288994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:18.335993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96f7e82915f4563b05c20c414c23229'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.343746 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96f7e82915f4563b05c20c414c23229'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.344422 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96f7e82915f4563b05c20c414c23229'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.356201 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96f7e82915f4563b05c20c414c23229'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.363837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-c54090e3-9cfb-46a0-bdc0-c0882320e240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96f7e82915f4563b05c20c414c23229'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.369931 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1384/2783] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:18 2022] DELETE /identity/v3/users/d96f7e82915f4563b05c20c414c23229 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:18.540786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:18.553003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba17a0-ab59-4b79-a364-45150cebf7d2 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:18.610518 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:18.611372 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.611652 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.612428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] PATH_INFO: `/v3/projects/18e2757f7e6644099af9e5510954a391` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.613841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e2757f7e6644099af9e5510954a391)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:18.615758 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:18.662804 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e2757f7e6644099af9e5510954a391', 'request_id': 'req-ce2bc597-3e0d-4381-9902-460799eab5e2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.668167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e2757f7e6644099af9e5510954a391', 'request_id': 'req-ce2bc597-3e0d-4381-9902-460799eab5e2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.674208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e2757f7e6644099af9e5510954a391', 'request_id': 'req-ce2bc597-3e0d-4381-9902-460799eab5e2'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.686384 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] The token cache is being invalidate because project 18e2757f7e6644099af9e5510954a391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:18.686670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.687293 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ce2bc597-3e0d-4381-9902-460799eab5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:18.688824 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1400/2784] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:18 2022] DELETE /identity/v3/projects/18e2757f7e6644099af9e5510954a391 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:18.694090 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.694387 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.694670 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.712643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:18.713879 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:18.773304 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1385/2785] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:18.781250 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.781547 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.781830 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.801742 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:18.802893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:18.810632 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1401/2786] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:18.814876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:18.824941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155ebd1-2560-46cf-9659-f43db7759e7b None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:18.829470 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:18.830129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.830414 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.831218 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.832025 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:57:18.832335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:18.833999 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:18.845741 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1386/2787] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:57:18.850116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:18.859842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0cfb5-1ba8-4360-a0f6-b4325d4f955d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:18.865291 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:18.865946 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.866228 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.866506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.867205 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:18.869088 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:18.894250 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1402/2788] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:18 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:18.898526 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:18.908610 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3a15f-c275-4854-b59f-00f1f3f58158 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:18.912267 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:18.968467 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:18.969125 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:18.969437 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:18.969712 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:18.970400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:18.972864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:18.992223 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1387/2789] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:18 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:57:18.996526 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.007226 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cedbea-8f18-4add-b504-ada232769b31 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.011839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.012492 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.012776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.013049 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.013800 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.015392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.026346 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1403/2790] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:19.030238 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.041439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad392cda-2731-4653-808d-0a0c13fadd2a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.046168 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5c9e8-c57e-47ee-be99-52a1027cef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.046852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5c9e8-c57e-47ee-be99-52a1027cef04 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.047134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5c9e8-c57e-47ee-be99-52a1027cef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.047410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5c9e8-c57e-47ee-be99-52a1027cef04 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.048135 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5c9e8-c57e-47ee-be99-52a1027cef04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.050469 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5c9e8-c57e-47ee-be99-52a1027cef04 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.060561 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1388/2791] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:19.064601 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.075108 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c07880-b49b-4197-bd7a-a01a111e1e57 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.080479 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.081495 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.081773 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.082075 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] PATH_INFO: `/v3/projects/fb414f2b540e42e09772376742e12885/users/57ea1eefa3bd48e4bb64a3120375479c/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.098277 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb414f2b540e42e09772376742e12885, user_id=57ea1eefa3bd48e4bb64a3120375479c, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.100937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.114633 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1404/2792] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:19 2022] PUT /identity/v3/projects/fb414f2b540e42e09772376742e12885/users/57ea1eefa3bd48e4bb64a3120375479c/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:57:19.125528 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.125818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.126095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.153705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] MFA Rules not processed for user `57ea1eefa3bd48e4bb64a3120375479c`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:19.154929 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:19.220722 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1389/2793] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:19.225583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.255956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:19.289726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086bbc1-fb14-4e40-bdb6-a1788a0a2408 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.294466 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.295115 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.295394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.295665 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.296348 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.298266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.324073 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1405/2794] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:19 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:19.328249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.340471 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66e89-c558-4287-b9cc-875998f00ad7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.399770 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.400450 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.400737 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.401018 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.401749 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.403673 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.424907 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1390/2795] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:19 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:19.429194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.439680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eb83-ed2b-4c35-8feb-b087e6818e00 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.446624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.447294 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.447579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.447932 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.448703 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.450347 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.462014 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1406/2796] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:19.466143 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.473175 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:19.477442 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20874c4-51a0-4e3b-9eaa-4afa0b7daf81 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.483300 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.484183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.484607 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.484902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] PATH_INFO: `/v3/projects/98610312a2ed4b678cb2519adf4665a3/users/ada28861aa944eb9a39391b6ecced7b5/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.505120 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98610312a2ed4b678cb2519adf4665a3, user_id=ada28861aa944eb9a39391b6ecced7b5, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.507810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.520431 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1391/2797] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:19 2022] PUT /identity/v3/projects/98610312a2ed4b678cb2519adf4665a3/users/ada28861aa944eb9a39391b6ecced7b5/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:19.524367 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.534597 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f327a4e-666d-48ce-b27f-bb795082d42b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.591041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a1bfb-0de9-4003-bc74-a6e7e976abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.591749 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a1bfb-0de9-4003-bc74-a6e7e976abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.591969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a1bfb-0de9-4003-bc74-a6e7e976abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.592248 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a1bfb-0de9-4003-bc74-a6e7e976abd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.592967 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a1bfb-0de9-4003-bc74-a6e7e976abd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.594594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a1bfb-0de9-4003-bc74-a6e7e976abd8 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.604384 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1407/2798] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:19.608399 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.619335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eca5b-0c59-4137-b7bf-b0b94400f6f6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.623966 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.624836 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.625116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.625424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] PATH_INFO: `/v3/projects/98610312a2ed4b678cb2519adf4665a3/users/ada28861aa944eb9a39391b6ecced7b5/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.627409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=98610312a2ed4b678cb2519adf4665a3, user_id=ada28861aa944eb9a39391b6ecced7b5, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.631024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.641042 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1392/2799] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:19 2022] PUT /identity/v3/projects/98610312a2ed4b678cb2519adf4665a3/users/ada28861aa944eb9a39391b6ecced7b5/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:19.651491 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.651786 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.652070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.678814 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] MFA Rules not processed for user `ada28861aa944eb9a39391b6ecced7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:19.680010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:19.748733 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1408/2800] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:19.759994 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:19.761772 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:19.822585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca805d2f-727e-48b8-8b8a-539418dca1ad admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:19.826259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac25100-b124-420a-950b-41d06b34a373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:19.826897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac25100-b124-420a-950b-41d06b34a373 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:19.827183 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac25100-b124-420a-950b-41d06b34a373 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:19.827460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac25100-b124-420a-950b-41d06b34a373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:19.836566 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac25100-b124-420a-950b-41d06b34a373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:19.838020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac25100-b124-420a-950b-41d06b34a373 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:19.848172 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1393/2801] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:20.212776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:20.238911 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:20.277328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f2d08-3a18-4ca6-8569-df50927bc69e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:20.281891 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:20.282785 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:20.283247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:20.283555 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] PATH_INFO: `/v3/users/57ea1eefa3bd48e4bb64a3120375479c` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:20.284925 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ea1eefa3bd48e4bb64a3120375479c)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:20.286889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:20.336094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ea1eefa3bd48e4bb64a3120375479c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.343240 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ea1eefa3bd48e4bb64a3120375479c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.343927 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ea1eefa3bd48e4bb64a3120375479c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.352651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ea1eefa3bd48e4bb64a3120375479c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.353279 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ea1eefa3bd48e4bb64a3120375479c'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.372741 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1409/2802] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:20 2022] DELETE /identity/v3/users/57ea1eefa3bd48e4bb64a3120375479c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:20.377445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:20.378869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:20.378869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:20.396048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:20.397282 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:20.455162 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1394/2803] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:20.465242 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:20.466634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:20.524581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f17d-2d5e-4d2d-9577-47d3657a8e72 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:20.528168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:20.528809 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:20.529094 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:20.529409 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:20.539111 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:20.540550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:20.550501 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1410/2804] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:20.809336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:20.810778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:20.823128 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a667-cb63-422a-933a-5dcec539ac24 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:20.828038 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:20.828991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:20.829374 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:20.829724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] PATH_INFO: `/v3/projects/fb414f2b540e42e09772376742e12885` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:20.831625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb414f2b540e42e09772376742e12885)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:20.833602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:20.881818 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb414f2b540e42e09772376742e12885', 'request_id': 'req-d6bf767a-08f4-4d80-bca0-c14450d67ee9'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.887869 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb414f2b540e42e09772376742e12885', 'request_id': 'req-d6bf767a-08f4-4d80-bca0-c14450d67ee9'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.893794 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb414f2b540e42e09772376742e12885', 'request_id': 'req-d6bf767a-08f4-4d80-bca0-c14450d67ee9'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.896191 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:20.908435 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] The token cache is being invalidate because project fb414f2b540e42e09772376742e12885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:20.908728 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.909441 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:20.910991 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1395/2805] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:20 2022] DELETE /identity/v3/projects/fb414f2b540e42e09772376742e12885 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:20.914973 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:20.925478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5ee3e-4397-47bf-8d33-0b6fe9e6c976 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:20.967527 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:20.984401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:20.985308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:20.985593 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:20.985870 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] PATH_INFO: `/v3/users/ada28861aa944eb9a39391b6ecced7b5` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:20.987633 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada28861aa944eb9a39391b6ecced7b5)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:20.989764 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.036956 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada28861aa944eb9a39391b6ecced7b5'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.043883 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada28861aa944eb9a39391b6ecced7b5'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.044542 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada28861aa944eb9a39391b6ecced7b5'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.052320 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada28861aa944eb9a39391b6ecced7b5'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.053007 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-88f61c62-2293-4422-92ad-f049475a89b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada28861aa944eb9a39391b6ecced7b5'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.070513 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1411/2806] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:20 2022] DELETE /identity/v3/users/ada28861aa944eb9a39391b6ecced7b5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:21.359567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.361035 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:21.376663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf767a-08f4-4d80-bca0-c14450d67ee9 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.436502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.437335 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.437622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.437908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] PATH_INFO: `/v3/projects/98610312a2ed4b678cb2519adf4665a3` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.439088 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98610312a2ed4b678cb2519adf4665a3)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.441686 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.489448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98610312a2ed4b678cb2519adf4665a3', 'request_id': 'req-0f5f244a-7522-4275-9658-952b1a69d907'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.495481 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98610312a2ed4b678cb2519adf4665a3', 'request_id': 'req-0f5f244a-7522-4275-9658-952b1a69d907'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.500905 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98610312a2ed4b678cb2519adf4665a3', 'request_id': 'req-0f5f244a-7522-4275-9658-952b1a69d907'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.513259 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] The token cache is being invalidate because project 98610312a2ed4b678cb2519adf4665a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:21.513546 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.514161 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-0f5f244a-7522-4275-9658-952b1a69d907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:21.515676 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1396/2807] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:21 2022] DELETE /identity/v3/projects/98610312a2ed4b678cb2519adf4665a3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:21.520645 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.520937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.521251 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.539360 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:21.540606 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:21.601017 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1412/2808] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:21.608940 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.609439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.609724 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.628096 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:21.629419 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:21.637078 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1397/2809] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:21.641076 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.651498 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac50b-3a52-40b3-b8a9-b6994dd916fd None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.655947 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.656600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.656879 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.657180 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.657889 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:57:21.658195 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.660502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.672191 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1413/2810] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:57:21.676665 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.685820 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64213b4f-45c4-419d-a873-f4c0056cc30a None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.690530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.691240 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.691522 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.691799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.692488 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.694402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.720403 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1398/2811] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:21 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:21.725154 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.734952 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24599d-6b75-44f4-b792-dfbcd9327265 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.781342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:21.794207 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.794913 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.795194 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.795469 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.796161 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.798179 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.816542 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1414/2812] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:21 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:21.820730 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.831391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ac15-e5ed-464e-b810-7d02d3814694 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.836265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.836923 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.837242 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.837525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.838248 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.839837 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.851401 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1399/2813] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:21.855200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.865727 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c74d65-7edb-487b-b8e5-12bbb7de2f2f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.870334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1046fba-97f7-4166-bbb8-ebbdcb548bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.870987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1046fba-97f7-4166-bbb8-ebbdcb548bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.871269 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1046fba-97f7-4166-bbb8-ebbdcb548bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.871548 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1046fba-97f7-4166-bbb8-ebbdcb548bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.872296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1046fba-97f7-4166-bbb8-ebbdcb548bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.873954 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1046fba-97f7-4166-bbb8-ebbdcb548bf1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.884812 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1415/2814] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:21.889012 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:21.899114 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5ad1-5181-436b-9588-0056aceb0797 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:21.903663 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:21.904550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.904831 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.905105 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] PATH_INFO: `/v3/projects/a32dd0e48b894d879c95c227b4b0a108/users/74c05d9a26c04ccebb14dcd91f4f13c3/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.919503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32dd0e48b894d879c95c227b4b0a108, user_id=74c05d9a26c04ccebb14dcd91f4f13c3, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:21.922226 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:21.936473 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1400/2815] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:21 2022] PUT /identity/v3/projects/a32dd0e48b894d879c95c227b4b0a108/users/74c05d9a26c04ccebb14dcd91f4f13c3/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:21.948001 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:21.948494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:21.948494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:21.975898 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] MFA Rules not processed for user `74c05d9a26c04ccebb14dcd91f4f13c3`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:21.977095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:22.044404 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1416/2816] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:22.048899 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.070186 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:22.113217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac3b0-3811-4e75-b298-3bbc16c8d364 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.117900 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.118555 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.118841 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.119122 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.119806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.121731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.147735 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1401/2817] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:22 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:22.151841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.162712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdfedd-58f8-4f06-a18a-51e088753a7e None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.220041 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.220707 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.220992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.221445 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.222516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.224483 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.244587 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1417/2818] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:22 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:22.248504 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.259574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af781-5018-4531-862c-a9f41468e2b1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.264230 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.264887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.265203 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.265489 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.266210 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.267817 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.278621 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1402/2819] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:22.282772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.293516 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39010-de7f-4112-9e5e-4cfa0d2ac84b admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.298021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.298885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.299166 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.300045 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] PATH_INFO: `/v3/projects/d36bbdc2df9f439a956e66070c8886ab/users/8c018f151d52487494a66a472f180c17/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.314515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36bbdc2df9f439a956e66070c8886ab, user_id=8c018f151d52487494a66a472f180c17, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.317417 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.340064 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1418/2820] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:22 2022] PUT /identity/v3/projects/d36bbdc2df9f439a956e66070c8886ab/users/8c018f151d52487494a66a472f180c17/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:22.343872 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.354802 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a610ace-6267-4e0d-8bec-9bc7fe1082c6 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.414383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3262b8-28ac-4b83-99a1-d87601c0120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.415048 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3262b8-28ac-4b83-99a1-d87601c0120e admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.415329 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3262b8-28ac-4b83-99a1-d87601c0120e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.415606 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3262b8-28ac-4b83-99a1-d87601c0120e admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.416324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3262b8-28ac-4b83-99a1-d87601c0120e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.417949 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3262b8-28ac-4b83-99a1-d87601c0120e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.427758 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1403/2821] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:22.431899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.442594 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b8d6-0e2a-4de4-8788-c9804d7514b1 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.447247 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.448130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.448415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.448696 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] PATH_INFO: `/v3/projects/d36bbdc2df9f439a956e66070c8886ab/users/8c018f151d52487494a66a472f180c17/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.450712 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36bbdc2df9f439a956e66070c8886ab, user_id=8c018f151d52487494a66a472f180c17, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.453415 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.464639 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1419/2822] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:22 2022] PUT /identity/v3/projects/d36bbdc2df9f439a956e66070c8886ab/users/8c018f151d52487494a66a472f180c17/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:22.475611 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.476110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.476110 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.503164 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] MFA Rules not processed for user `8c018f151d52487494a66a472f180c17`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:22.504451 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:22.572539 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1404/2823] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:57:22.584310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:22.586401 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:22.600254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:22.644581 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73d53-e2b6-400c-92d5-079af8943b41 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:22.648209 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:22.648842 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:22.649122 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:22.649427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:22.706615 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:22.708053 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:22.717353 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1420/2824] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:25.275791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:25.285982 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3708e9-f07b-40c9-8058-55a157a9a773 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:25.289474 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635f9c0-81eb-43e0-87fe-fd906d0503b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:25.290106 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635f9c0-81eb-43e0-87fe-fd906d0503b6 service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:25.290386 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635f9c0-81eb-43e0-87fe-fd906d0503b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:25.290662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635f9c0-81eb-43e0-87fe-fd906d0503b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:25.300219 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635f9c0-81eb-43e0-87fe-fd906d0503b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:25.301731 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635f9c0-81eb-43e0-87fe-fd906d0503b6 service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:25.311020 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1405/2825] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:32.713343 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=43 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:35.306813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:37.664724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:37.728374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04de3-8932-480f-b414-5023661dbc62 service cinder] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:37.732873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:37.733766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:37.734051 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:37.734326 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] PATH_INFO: `/v3/users/74c05d9a26c04ccebb14dcd91f4f13c3` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:37.735510 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c05d9a26c04ccebb14dcd91f4f13c3)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:37.737811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:37.782906 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c05d9a26c04ccebb14dcd91f4f13c3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:37.790272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c05d9a26c04ccebb14dcd91f4f13c3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:37.790919 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c05d9a26c04ccebb14dcd91f4f13c3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:37.797843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c05d9a26c04ccebb14dcd91f4f13c3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:37.798576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c05d9a26c04ccebb14dcd91f4f13c3'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:37.816559 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1421/2826] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:37 2022] DELETE /identity/v3/users/74c05d9a26c04ccebb14dcd91f4f13c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:37.821509 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:37.822009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:37.822109 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:37.839634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:37.840835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:37.899159 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1406/2827] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:37.908841 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:37.910280 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:37.968772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fab132-e0af-4376-a95d-9b813fb500b3 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:37.972424 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:37.973113 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:37.973471 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:37.973750 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:37.982853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:37.984290 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:37.993778 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1422/2828] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:38.260160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:38.261672 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:38.276152 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eab148-b04f-45ec-970f-f9a4a1aea82d None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:38.280846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:38.281762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:38.282050 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:38.282472 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] PATH_INFO: `/v3/projects/a32dd0e48b894d879c95c227b4b0a108` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:38.283671 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32dd0e48b894d879c95c227b4b0a108)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:38.286207 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:38.332215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32dd0e48b894d879c95c227b4b0a108', 'request_id': 'req-83fa46c2-6a7a-4bfa-8386-07e35341489b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.339354 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32dd0e48b894d879c95c227b4b0a108', 'request_id': 'req-83fa46c2-6a7a-4bfa-8386-07e35341489b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.344884 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32dd0e48b894d879c95c227b4b0a108', 'request_id': 'req-83fa46c2-6a7a-4bfa-8386-07e35341489b'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.357550 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] The token cache is being invalidate because project a32dd0e48b894d879c95c227b4b0a108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:38.357838 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.358462 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.360016 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1407/2829] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:38 2022] DELETE /identity/v3/projects/a32dd0e48b894d879c95c227b4b0a108 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:38.364852 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:38.374450 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a8842-304f-4c18-aac9-df1090579bb8 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:38.393237 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:38.435811 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:38.436592 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:38.436872 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:38.437167 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] PATH_INFO: `/v3/users/8c018f151d52487494a66a472f180c17` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:38.438335 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c018f151d52487494a66a472f180c17)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:38.440261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:38.485499 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c018f151d52487494a66a472f180c17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.493289 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c018f151d52487494a66a472f180c17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.494008 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c018f151d52487494a66a472f180c17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.501085 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c018f151d52487494a66a472f180c17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.502208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-4d1b6cfd-0930-4023-b69b-7f8906c81f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c018f151d52487494a66a472f180c17'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.519370 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1423/2830] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:38 2022] DELETE /identity/v3/users/8c018f151d52487494a66a472f180c17 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:38.796157 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:38.797727 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:38.813452 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa46c2-6a7a-4bfa-8386-07e35341489b admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:38.871925 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:38.872792 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:38.873075 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:38.873384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] PATH_INFO: `/v3/projects/d36bbdc2df9f439a956e66070c8886ab` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:38.874563 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36bbdc2df9f439a956e66070c8886ab)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:38.876461 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:38.906554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:38.932500 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36bbdc2df9f439a956e66070c8886ab', 'request_id': 'req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.938662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36bbdc2df9f439a956e66070c8886ab', 'request_id': 'req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.944969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36bbdc2df9f439a956e66070c8886ab', 'request_id': 'req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.962952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] The token cache is being invalidate because project d36bbdc2df9f439a956e66070c8886ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:38.963295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.963871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-53e7d658-95aa-4601-bcf0-f7a3ccf3a433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:38.965500 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1408/2831] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:38 2022] DELETE /identity/v3/projects/d36bbdc2df9f439a956e66070c8886ab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:38.970371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:38.970857 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:38.970970 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:38.989442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:38.990649 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:39.050316 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1424/2832] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:57:39.058742 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.059024 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.059308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.079408 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:39.080618 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:39.088860 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1409/2833] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:39.092992 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.102874 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a426d07-9bf3-482a-ab83-aa922cb2c0da None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.107429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.108072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.108354 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.108631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.109404 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:57:39.109711 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.111342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.123392 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1425/2834] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:57:39.127515 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.138072 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab3dd-9e84-4ac7-b12a-55d208ae7a03 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.142764 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.143420 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.143709 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.143993 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.144692 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.146902 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.172329 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1410/2835] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:39.178963 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.189134 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01897-9d03-48e6-9012-3f00806c42db admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.215296 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:39.247612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.248274 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.248556 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.248838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.249552 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.251478 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.270459 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1426/2836] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:39.274616 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.284769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47fe64-b696-4daf-8718-30c521f7c3e1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.290178 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.290853 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.291118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.291388 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.292108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.293707 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.304998 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1411/2837] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:39.308899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.319172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b769e-74b2-455d-a339-c02adf1fe46e admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.323757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a75be-6889-454c-9443-87b79b765052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.324422 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a75be-6889-454c-9443-87b79b765052 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.324688 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a75be-6889-454c-9443-87b79b765052 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.324965 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a75be-6889-454c-9443-87b79b765052 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.325719 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a75be-6889-454c-9443-87b79b765052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.327325 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a75be-6889-454c-9443-87b79b765052 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.338085 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1427/2838] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:39.342127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.352811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de327fa-70d9-45ce-981f-bbb22920f33c admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.357359 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.358227 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.358506 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.358778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] PATH_INFO: `/v3/projects/33b621bf5e9540449e2b6eaca62c83c6/users/ff4feaf7ab56466195aa02131afbd854/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.373827 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b621bf5e9540449e2b6eaca62c83c6, user_id=ff4feaf7ab56466195aa02131afbd854, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.376455 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.389246 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1412/2839] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:39 2022] PUT /identity/v3/projects/33b621bf5e9540449e2b6eaca62c83c6/users/ff4feaf7ab56466195aa02131afbd854/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:39.400634 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.400914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.401227 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.428402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] MFA Rules not processed for user `ff4feaf7ab56466195aa02131afbd854`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:39.429635 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:39.494559 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1428/2840] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:39.498738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.560593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165154f-9bbc-4631-ae94-042422cfe868 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.565189 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.565835 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.566116 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.566390 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.567396 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.569295 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.594057 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1413/2841] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:39.598850 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.609612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf881f-4eaa-461f-af9f-8219721e035b None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.666043 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.666723 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.666989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.667272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.667950 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.669907 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.690457 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1429/2842] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:39.694680 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.705089 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9cc7-571e-4de3-9a5b-859f67c82ed2 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.710586 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.711246 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.711530 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.711807 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.712527 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.714138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.725290 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1414/2843] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:39.729625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.741057 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99dd3-9c4a-4ec1-aea8-612cb8d0b9cc admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.745780 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.746625 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.746910 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.747187 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] PATH_INFO: `/v3/projects/16b39bcbad8a432ab2d16fc6dd187e93/users/a807325ac31445cb848d792c006996f5/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.762613 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b39bcbad8a432ab2d16fc6dd187e93, user_id=a807325ac31445cb848d792c006996f5, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.765331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.779495 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1430/2844] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:39 2022] PUT /identity/v3/projects/16b39bcbad8a432ab2d16fc6dd187e93/users/a807325ac31445cb848d792c006996f5/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:39.783424 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.794030 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543021e-8bfe-4aae-8f7c-2a1365c595ae admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.814036 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:39.851806 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6c1a0-3587-49e1-bbd7-0745ca36675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.852466 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6c1a0-3587-49e1-bbd7-0745ca36675c admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.852744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6c1a0-3587-49e1-bbd7-0745ca36675c admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.853020 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6c1a0-3587-49e1-bbd7-0745ca36675c admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.853773 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6c1a0-3587-49e1-bbd7-0745ca36675c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.855436 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6c1a0-3587-49e1-bbd7-0745ca36675c admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.865746 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1415/2845] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:39.869853 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:39.875339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:39.882301 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225cd8a-5404-433c-873c-e71cd998b3aa admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:39.887386 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:39.888285 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.888565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.888838 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] PATH_INFO: `/v3/projects/16b39bcbad8a432ab2d16fc6dd187e93/users/a807325ac31445cb848d792c006996f5/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.890818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b39bcbad8a432ab2d16fc6dd187e93, user_id=a807325ac31445cb848d792c006996f5, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:39.893507 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:39.903932 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1431/2846] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:39 2022] PUT /identity/v3/projects/16b39bcbad8a432ab2d16fc6dd187e93/users/a807325ac31445cb848d792c006996f5/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:57:39.914675 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:39.915153 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:39.915278 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:39.941409 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] MFA Rules not processed for user `a807325ac31445cb848d792c006996f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:39.943439 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:40.011324 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1416/2847] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:40.022342 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:40.024069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:40.080790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e8f3-4ea1-4806-9188-b22a3a46c838 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:40.085535 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f0f0-7ad4-45d4-ae88-d0260dcdc7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:40.086163 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f0f0-7ad4-45d4-ae88-d0260dcdc7de service cinder] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:40.086444 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f0f0-7ad4-45d4-ae88-d0260dcdc7de service cinder] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:40.086718 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f0f0-7ad4-45d4-ae88-d0260dcdc7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:40.095536 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f0f0-7ad4-45d4-ae88-d0260dcdc7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:40.096972 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f0f0-7ad4-45d4-ae88-d0260dcdc7de service cinder] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:40.106639 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1432/2848] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:40.804138 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:40.865762 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aaf98-3e83-4903-91a4-3bf8119450a7 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:40.870176 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:40.871039 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:40.871324 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:40.871604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] PATH_INFO: `/v3/users/ff4feaf7ab56466195aa02131afbd854` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:40.872862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4feaf7ab56466195aa02131afbd854)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:40.874842 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:40.920158 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4feaf7ab56466195aa02131afbd854'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:40.921383 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:40.929862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4feaf7ab56466195aa02131afbd854'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:40.930519 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4feaf7ab56466195aa02131afbd854'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:40.942333 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4feaf7ab56466195aa02131afbd854'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:40.949571 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4feaf7ab56466195aa02131afbd854'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:40.955449 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1417/2849] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:40 2022] DELETE /identity/v3/users/ff4feaf7ab56466195aa02131afbd854 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:40.960560 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:40.960845 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:40.961120 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:40.979437 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:40.980668 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:41.041660 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1433/2850] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:41.051129 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:41.052778 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:41.109826 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f314-1a66-4e7c-bc1b-e0d91abfa3df admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:41.113413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:41.114340 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:41.114695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:41.114974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:41.124100 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:41.125490 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:41.135112 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1418/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:41.397979 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:41.399427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:41.413261 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff30f4a-48dd-4a65-8a13-21a840528c62 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:41.417978 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:41.418848 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:41.419130 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:41.419403 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] PATH_INFO: `/v3/projects/33b621bf5e9540449e2b6eaca62c83c6` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:41.420609 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b621bf5e9540449e2b6eaca62c83c6)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:41.422579 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:41.473837 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b621bf5e9540449e2b6eaca62c83c6', 'request_id': 'req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.479387 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b621bf5e9540449e2b6eaca62c83c6', 'request_id': 'req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.485537 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b621bf5e9540449e2b6eaca62c83c6', 'request_id': 'req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.498181 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] The token cache is being invalidate because project 33b621bf5e9540449e2b6eaca62c83c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:41.498614 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.507339 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.507339 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1434/2852] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:41 2022] DELETE /identity/v3/projects/33b621bf5e9540449e2b6eaca62c83c6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:41.507864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:41.514862 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3addc7-82f1-4c3a-9ef3-aca2203f926a service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:41.572622 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:41.573585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:41.573871 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:41.574147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] PATH_INFO: `/v3/users/a807325ac31445cb848d792c006996f5` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:41.575331 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a807325ac31445cb848d792c006996f5)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:41.577297 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:41.624676 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a807325ac31445cb848d792c006996f5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.631969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a807325ac31445cb848d792c006996f5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.632628 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a807325ac31445cb848d792c006996f5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.642625 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:41.644502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a807325ac31445cb848d792c006996f5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.653198 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-79cbb5be-a981-4334-a319-4a66bbce0266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a807325ac31445cb848d792c006996f5'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:41.659642 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1419/2853] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:41 2022] DELETE /identity/v3/users/a807325ac31445cb848d792c006996f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:41.932308 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:41.933799 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:41.947600 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feb9e9-27f0-4db8-ad22-e1c2401ac089 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:41.962543 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:42.011172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.012021 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.012324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.012596 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] PATH_INFO: `/v3/projects/16b39bcbad8a432ab2d16fc6dd187e93` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.013784 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b39bcbad8a432ab2d16fc6dd187e93)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.015755 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.063473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b39bcbad8a432ab2d16fc6dd187e93', 'request_id': 'req-18946b0a-47b0-458b-8af6-2dcdef9765df'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:42.069427 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b39bcbad8a432ab2d16fc6dd187e93', 'request_id': 'req-18946b0a-47b0-458b-8af6-2dcdef9765df'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:42.075494 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b39bcbad8a432ab2d16fc6dd187e93', 'request_id': 'req-18946b0a-47b0-458b-8af6-2dcdef9765df'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:42.088482 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] The token cache is being invalidate because project 16b39bcbad8a432ab2d16fc6dd187e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:42.088766 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:42.089464 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-18946b0a-47b0-458b-8af6-2dcdef9765df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:42.091029 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1435/2854] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:41 2022] DELETE /identity/v3/projects/16b39bcbad8a432ab2d16fc6dd187e93 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:42.095882 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.096384 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.096497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.115667 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:42.116868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:42.186156 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1420/2855] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:42.195540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.195847 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.196114 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.215272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:42.216488 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:42.224673 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1436/2856] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:42.279716 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.289868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a6eb-22b2-4d5f-8c6d-28fd58c98e12 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.294525 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da604-d082-4858-b079-40725d29dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.295173 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da604-d082-4858-b079-40725d29dead admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.295456 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da604-d082-4858-b079-40725d29dead admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.295735 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da604-d082-4858-b079-40725d29dead admin admin] PATH_INFO: `/v3/domains` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.296448 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da604-d082-4858-b079-40725d29dead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:57:42.296753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da604-d082-4858-b079-40725d29dead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.298394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da604-d082-4858-b079-40725d29dead admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.309842 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1421/2857] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:57:42.314052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.323916 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b15f8-4d15-4d64-8af1-69e3317e225d None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.328689 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.329370 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.329658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.329937 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.330624 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.333200 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.361558 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1437/2858] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:42.365706 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da604-d082-4858-b079-40725d29dead admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.375660 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da604-d082-4858-b079-40725d29dead admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.436413 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.437002 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.437322 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.437605 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.438298 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.440214 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.466559 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1422/2859] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:42.470730 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.481054 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e4f9-534e-4beb-8f85-197341e76873 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.485675 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.486328 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.486608 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.486885 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.487604 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.489321 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.499576 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1438/2860] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:57:42.503523 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.514790 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f994-9349-4227-9d3a-b02eb3f44540 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.519799 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd24b-ed8c-4b9f-b315-a5a380d12d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.521216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd24b-ed8c-4b9f-b315-a5a380d12d5a admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.521503 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd24b-ed8c-4b9f-b315-a5a380d12d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.521779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd24b-ed8c-4b9f-b315-a5a380d12d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.522494 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd24b-ed8c-4b9f-b315-a5a380d12d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.524080 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd24b-ed8c-4b9f-b315-a5a380d12d5a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.533934 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1423/2861] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:42.538522 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.548506 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290cdc1-911a-4454-be72-1f21d88f1336 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.553720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.554586 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.554873 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.555151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] PATH_INFO: `/v3/projects/ffb73c243cdc406881afe1ccfb330f86/users/6b09264f3a9e4779b7dff62bafe92525/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.570216 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb73c243cdc406881afe1ccfb330f86, user_id=6b09264f3a9e4779b7dff62bafe92525, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.572839 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.585397 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1439/2862] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:42 2022] PUT /identity/v3/projects/ffb73c243cdc406881afe1ccfb330f86/users/6b09264f3a9e4779b7dff62bafe92525/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:42.595293 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.595579 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.595864 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.622539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] MFA Rules not processed for user `6b09264f3a9e4779b7dff62bafe92525`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:42.623777 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:42.664909 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:42.688688 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1424/2863] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:42.693710 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.737728 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:42.757580 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c5d9c-9d23-449c-b015-47d382fb2f86 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.762151 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.762801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.763086 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.763359 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.764033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.765969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.791984 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1440/2864] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:42.795744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.808597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016db7bb-a887-4006-9e77-2a49775c63bf None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.867045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.867705 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.867991 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.868268 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.868948 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.871151 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.892054 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1425/2865] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:42 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:57:42.895550 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.905914 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173c2a-2eee-4a03-86d6-1fb973726bdf admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.911096 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.911886 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.912174 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.912457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.913206 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.914818 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.925407 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1441/2866] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:42.930337 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.940549 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a63e7-6ec2-4d09-ad61-46d6ab6fa3c1 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:42.945134 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:42.946060 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:42.946341 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:42.946619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] PATH_INFO: `/v3/projects/e908435e5a774854af37546ef53fd63c/users/289c9f7770c147e4a62ac8e524963422/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:42.961576 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e908435e5a774854af37546ef53fd63c, user_id=289c9f7770c147e4a62ac8e524963422, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:42.964221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:42.977575 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1426/2867] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:42 2022] PUT /identity/v3/projects/e908435e5a774854af37546ef53fd63c/users/289c9f7770c147e4a62ac8e524963422/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:42.981534 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:42.992687 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542446f-ad44-45d7-86fa-447ee9825d0f admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:43.048185 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de2ed-1063-4df3-907e-4abeda84204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:43.048849 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de2ed-1063-4df3-907e-4abeda84204e admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:43.049135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de2ed-1063-4df3-907e-4abeda84204e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:43.049448 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de2ed-1063-4df3-907e-4abeda84204e admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:43.050168 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2de2ed-1063-4df3-907e-4abeda84204e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:43.052442 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2de2ed-1063-4df3-907e-4abeda84204e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:43.062279 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1442/2868] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:43.066216 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:43.076815 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2b183-676d-465a-abdc-9751f56837ab admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:43.081573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:43.082599 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:43.082992 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:43.083217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] PATH_INFO: `/v3/projects/e908435e5a774854af37546ef53fd63c/users/289c9f7770c147e4a62ac8e524963422/roles/5e4eaa0fc481419bb2ae62db863607d1` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:43.085561 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e908435e5a774854af37546ef53fd63c, user_id=289c9f7770c147e4a62ac8e524963422, role_id=5e4eaa0fc481419bb2ae62db863607d1)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:43.088217 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:43.099732 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1427/2869] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:43 2022] PUT /identity/v3/projects/e908435e5a774854af37546ef53fd63c/users/289c9f7770c147e4a62ac8e524963422/roles/5e4eaa0fc481419bb2ae62db863607d1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:43.109990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:43.110434 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:43.110554 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:43.137254 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] MFA Rules not processed for user `289c9f7770c147e4a62ac8e524963422`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:43.138473 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:43.206162 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1443/2870] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:43.216901 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:43.218695 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:43.276939 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434346f0-d4c2-4fca-8950-dec739271983 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:43.280621 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb22e2-3dcb-47c1-903e-d334f8e8e50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae6a98bfbada4666852398c78efce936', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:43.281308 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb22e2-3dcb-47c1-903e-d334f8e8e50f service cinder] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:43.281597 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb22e2-3dcb-47c1-903e-d334f8e8e50f service cinder] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:43.281878 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb22e2-3dcb-47c1-903e-d334f8e8e50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:43.328085 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:43.339887 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb22e2-3dcb-47c1-903e-d334f8e8e50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:43.341402 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb22e2-3dcb-47c1-903e-d334f8e8e50f service cinder] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:43.351396 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1428/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:46.050855 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:46.096890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:46.119009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b858820-5ff9-4e46-b82a-30547fce36b5 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:46.123776 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:46.124637 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:46.124915 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:46.125218 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] PATH_INFO: `/v3/users/6b09264f3a9e4779b7dff62bafe92525` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:46.126389 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b09264f3a9e4779b7dff62bafe92525)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:46.128324 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:46.174394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b09264f3a9e4779b7dff62bafe92525'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.181334 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b09264f3a9e4779b7dff62bafe92525'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.182002 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b09264f3a9e4779b7dff62bafe92525'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.189025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b09264f3a9e4779b7dff62bafe92525'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.189670 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b09264f3a9e4779b7dff62bafe92525'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.207896 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1444/2872] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:46 2022] DELETE /identity/v3/users/6b09264f3a9e4779b7dff62bafe92525 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:46.212875 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68567-f628-4166-8d06-50a942b983fd None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:46.213497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68567-f628-4166-8d06-50a942b983fd None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:46.213497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68567-f628-4166-8d06-50a942b983fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:46.230602 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-97e68567-f628-4166-8d06-50a942b983fd None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:46.231857 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-97e68567-f628-4166-8d06-50a942b983fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:46.290671 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1429/2873] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:46.299987 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:46.301941 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:46.361150 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8eb9-fe62-4bd6-b7d5-b2b55c33e898 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:46.365429 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:46.366092 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:46.366374 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:46.366653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:46.376048 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:46.377576 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:46.387285 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1445/2874] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:46.667033 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e68567-f628-4166-8d06-50a942b983fd None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:46.668539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-97e68567-f628-4166-8d06-50a942b983fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:46.680703 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e68567-f628-4166-8d06-50a942b983fd None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:46.685312 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:46.686180 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:46.686460 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:46.686738 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] PATH_INFO: `/v3/projects/ffb73c243cdc406881afe1ccfb330f86` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:46.687953 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb73c243cdc406881afe1ccfb330f86)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:46.689924 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:46.737445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb73c243cdc406881afe1ccfb330f86', 'request_id': 'req-1667670e-b18b-4879-b1fe-c6cb7f832549'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.743617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb73c243cdc406881afe1ccfb330f86', 'request_id': 'req-1667670e-b18b-4879-b1fe-c6cb7f832549'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.749363 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb73c243cdc406881afe1ccfb330f86', 'request_id': 'req-1667670e-b18b-4879-b1fe-c6cb7f832549'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.762429 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] The token cache is being invalidate because project ffb73c243cdc406881afe1ccfb330f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:46.762721 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.763336 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.764871 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1430/2875] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:46 2022] DELETE /identity/v3/projects/ffb73c243cdc406881afe1ccfb330f86 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:46.768880 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:46.779539 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549a073-90be-49a0-a78a-a6dc9a55dd8c service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:46.835565 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:46.836352 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:46.836631 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:46.836901 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] PATH_INFO: `/v3/users/289c9f7770c147e4a62ac8e524963422` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:46.838103 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] RBAC: Authorizing `identity:delete_user(user_id=289c9f7770c147e4a62ac8e524963422)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:46.840039 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:46.841540 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:46.887392 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289c9f7770c147e4a62ac8e524963422'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.894147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289c9f7770c147e4a62ac8e524963422'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.895376 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289c9f7770c147e4a62ac8e524963422'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.902653 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289c9f7770c147e4a62ac8e524963422'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.903428 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-87aac6b3-c3e5-4092-971a-36025f1c306e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289c9f7770c147e4a62ac8e524963422'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:46.920477 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1446/2876] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:57:46 2022] DELETE /identity/v3/users/289c9f7770c147e4a62ac8e524963422 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:47.185880 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.187484 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:47.205281 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667670e-b18b-4879-b1fe-c6cb7f832549 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.264332 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.265236 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.265529 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.265814 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] PATH_INFO: `/v3/projects/e908435e5a774854af37546ef53fd63c` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.267009 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e908435e5a774854af37546ef53fd63c)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.268961 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.284883 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:47.317698 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e908435e5a774854af37546ef53fd63c', 'request_id': 'req-d347bbde-4e5c-428e-905b-9cc7543d12d8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:47.323718 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e908435e5a774854af37546ef53fd63c', 'request_id': 'req-d347bbde-4e5c-428e-905b-9cc7543d12d8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:47.329360 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e908435e5a774854af37546ef53fd63c', 'request_id': 'req-d347bbde-4e5c-428e-905b-9cc7543d12d8'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:47.347539 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] The token cache is being invalidate because project e908435e5a774854af37546ef53fd63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:57:47.347897 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:47.348604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-d347bbde-4e5c-428e-905b-9cc7543d12d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:57:47.350205 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1431/2877] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:57:47 2022] DELETE /identity/v3/projects/e908435e5a774854af37546ef53fd63c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:47.355069 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.355520 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.355651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.373760 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:47.374887 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:47.434216 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1447/2878] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:47.442983 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.443347 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.443697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.462368 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:47.463594 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:47.471642 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1432/2879] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:47.476523 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.486255 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065c0d1-4772-4835-88fa-b30c0f7c9162 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.491407 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.492052 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.492331 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.492607 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.493379 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:57:47.493686 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.495282 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.506837 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1448/2880] 10.222.0.45 () {58 vars in 1152 bytes} [Mon May 23 12:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:57:47.510950 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.520221 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b46f2d-03d8-4dc8-9cd7-e8eafe7c6fac None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.524937 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.525617 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.525907 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.526193 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.526891 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.528810 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.555346 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1433/2881] 10.222.0.45 () {60 vars in 1152 bytes} [Mon May 23 12:57:47 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:57:47.559490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.569909 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080cab2-510e-4246-a7fa-405eb656b1b7 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.627681 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.628276 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.628563 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.628840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] PATH_INFO: `/v3/users` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.629611 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.631585 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.641010 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:47.653349 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1449/2882] 10.222.0.45 () {60 vars in 1143 bytes} [Mon May 23 12:57:47 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:57:47.657394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.668108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7ba8-b417-4a6c-941b-379596677a40 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.672697 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.673371 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.673656 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.673931 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] PATH_INFO: `/v3/roles` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.674649 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.676813 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.687125 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1434/2883] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:47.690948 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.701098 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbc3f-cb3f-4679-bf69-8651d4f88a48 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.705806 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0176ba-43e3-4bfa-910e-57fa8d198113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.706457 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0176ba-43e3-4bfa-910e-57fa8d198113 admin admin] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.706790 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0176ba-43e3-4bfa-910e-57fa8d198113 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.707073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0176ba-43e3-4bfa-910e-57fa8d198113 admin admin] PATH_INFO: `/v3/roles` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.707985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0176ba-43e3-4bfa-910e-57fa8d198113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.709646 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0176ba-43e3-4bfa-910e-57fa8d198113 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.719909 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1450/2884] 10.222.0.45 () {58 vars in 1121 bytes} [Mon May 23 12:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:57:47.724619 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.734613 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08de740-5c2a-44ec-9c2a-0d259ea7c462 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.739809 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.740666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] REQUEST_METHOD: `PUT` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.740952 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.741260 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] PATH_INFO: `/v3/projects/81010dbeb0c24c1f9eeff31108d819a0/users/505ae2a4833f45ee98caeece93c06502/roles/7c75c0d6bb084b3389f8d26bebd09b23` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.755965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81010dbeb0c24c1f9eeff31108d819a0, user_id=505ae2a4833f45ee98caeece93c06502, role_id=7c75c0d6bb084b3389f8d26bebd09b23)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.758666 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.772127 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1435/2885] 10.222.0.45 () {60 vars in 1482 bytes} [Mon May 23 12:57:47 2022] PUT /identity/v3/projects/81010dbeb0c24c1f9eeff31108d819a0/users/505ae2a4833f45ee98caeece93c06502/roles/7c75c0d6bb084b3389f8d26bebd09b23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:57:47.782143 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.782439 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.782724 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.809528 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] MFA Rules not processed for user `505ae2a4833f45ee98caeece93c06502`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:57:47.810782 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:47.874347 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1451/2886] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:57:47.886086 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:57:47.887791 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:57:47.956908 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841c5e2-335f-4c42-9b78-6b22bd31892a admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:57:47.960823 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f50c773fb0c4b1bb1da7133725f7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:57:47.961497 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:57:47.961779 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:57:47.962059 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:57:47.970348 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:57:47.971780 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:57:47.980762 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1436/2887] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:57:57.871420 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=39 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:57.977215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:58:00.839366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:00.840819 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:00.896757 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbaa8-eda2-43cf-986c-d5b5b97a3c41 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:00.900796 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:00.901490 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:00.901798 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:00.902080 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:00.903949 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:00.975330 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:00.976781 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:00.989049 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1452/2888] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:58:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:58:02.162155 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:02.163574 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:02.176482 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629761b-0b6e-41f7-b0b0-b187795251e8 service glance] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:02.180108 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:02.180801 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:02.181094 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:02.181370 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:02.183147 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:02.196634 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:02.198118 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42ad1-986d-4f99-ad63-1ebe37aeb262 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:02.209190 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1437/2889] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:58:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:58:08.318388 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:08.381575 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c50e4e-0da3-4a11-81f1-ea47add25ee5 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:08.386866 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:08.387721 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:08.388116 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:08.388402 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] PATH_INFO: `/v3/users/505ae2a4833f45ee98caeece93c06502` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:08.389583 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505ae2a4833f45ee98caeece93c06502)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:08.391519 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:08.434371 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:58:08.437365 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505ae2a4833f45ee98caeece93c06502'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:08.445042 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505ae2a4833f45ee98caeece93c06502'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:08.445720 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505ae2a4833f45ee98caeece93c06502'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:08.453641 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505ae2a4833f45ee98caeece93c06502'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:08.454266 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505ae2a4833f45ee98caeece93c06502'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:08.472446 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1453/2890] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:58:08 2022] DELETE /identity/v3/users/505ae2a4833f45ee98caeece93c06502 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:58:08.476914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:08.477445 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:08.477889 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:08.494965 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] MFA Rules not processed for user `a725360ad03a444db8a80dca5cc7c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:58:08.496160 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:08.554024 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1438/2891] 10.222.0.45 () {58 vars in 957 bytes} [Mon May 23 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:58:08.563726 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:08.565175 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:08.623357 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf1fa0-efa4-4584-a4df-f1c41a152783 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:08.626980 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4d263-da48-46bf-95b7-e33f2f37282c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:08.627613 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4d263-da48-46bf-95b7-e33f2f37282c service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:08.627890 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4d263-da48-46bf-95b7-e33f2f37282c service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:08.628162 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4d263-da48-46bf-95b7-e33f2f37282c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:08.637917 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4d263-da48-46bf-95b7-e33f2f37282c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:08.639394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4d263-da48-46bf-95b7-e33f2f37282c service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:08.649799 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1454/2892] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:58:08.916342 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:08.917986 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:08.934126 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59a7e4-003b-43a8-b981-3a7c20b9eaf8 None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:08.939265 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:08.940215 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:08.940392 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:08.940678 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] PATH_INFO: `/v3/projects/81010dbeb0c24c1f9eeff31108d819a0` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:08.941852 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81010dbeb0c24c1f9eeff31108d819a0)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:08.943747 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:08.991590 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81010dbeb0c24c1f9eeff31108d819a0', 'request_id': 'req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:08.998573 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81010dbeb0c24c1f9eeff31108d819a0', 'request_id': 'req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:09.004056 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81010dbeb0c24c1f9eeff31108d819a0', 'request_id': 'req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:09.016944 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] The token cache is being invalidate because project 81010dbeb0c24c1f9eeff31108d819a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:58:09.017256 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:09.017868 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-23a9c16b-c902-4b45-a7f3-ea7cf9cd221e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:58:09.019388 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1439/2893] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:58:08 2022] DELETE /identity/v3/projects/81010dbeb0c24c1f9eeff31108d819a0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:58:12.973986 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4fa7-a32a-4ab1-b5c3-a3cbfb11d732 None None] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:12.974574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4fa7-a32a-4ab1-b5c3-a3cbfb11d732 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:12.974574 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4fa7-a32a-4ab1-b5c3-a3cbfb11d732 None None] PATH_INFO: `/` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:12.975915 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1455/2894] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:58:12.983554 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263a76-e883-4b80-a963-6b4e0f278549 None None] REQUEST_METHOD: `POST` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:12.984074 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263a76-e883-4b80-a963-6b4e0f278549 None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:12.984195 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263a76-e883-4b80-a963-6b4e0f278549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:13.029585 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.auth.core [None req-50263a76-e883-4b80-a963-6b4e0f278549 None None] MFA Rules not processed for user `65f0216a9bf54212a72d41ce9f6cc01c`. Rule list: `[]` (Enabled: `True`). {{(pid=90355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:58:13.030847 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-50263a76-e883-4b80-a963-6b4e0f278549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:13.086287 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1440/2895] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:58:13.099124 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4fa7-a32a-4ab1-b5c3-a3cbfb11d732 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:13.101595 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-db5b4fa7-a32a-4ab1-b5c3-a3cbfb11d732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:13.116073 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4fa7-a32a-4ab1-b5c3-a3cbfb11d732 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:13.120202 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89749a-aadb-4e76-ad63-ef27193d619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:13.120985 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89749a-aadb-4e76-ad63-ef27193d619a service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:13.121329 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89749a-aadb-4e76-ad63-ef27193d619a service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:13.121612 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89749a-aadb-4e76-ad63-ef27193d619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:13.128737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89749a-aadb-4e76-ad63-ef27193d619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:13.130199 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89749a-aadb-4e76-ad63-ef27193d619a service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:13.140390 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1456/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:58:13.222391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e109cf-4ba3-4f3c-a011-28301ba57fbc None None] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:13.222684 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e109cf-4ba3-4f3c-a011-28301ba57fbc None None] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:13.222973 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e109cf-4ba3-4f3c-a011-28301ba57fbc None None] PATH_INFO: `/` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:13.224352 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1441/2897] 10.222.0.45 () {54 vars in 921 bytes} [Mon May 23 12:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:58:13.229737 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] REQUEST_METHOD: `POST` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:13.230025 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:13.230336 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:13.250449 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.auth.core [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] MFA Rules not processed for user `e8c5ebd15be54c6badb07f37d58bda07`. Rule list: `[]` (Enabled: `True`). {{(pid=90356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:58:13.251658 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:13.317075 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1457/2898] 10.222.0.45 () {58 vars in 1018 bytes} [Mon May 23 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:58:13.328034 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e109cf-4ba3-4f3c-a011-28301ba57fbc None None] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:13.339753 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e109cf-4ba3-4f3c-a011-28301ba57fbc None None] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:13.343343 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:13.343989 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:13.344277 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:13.344567 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:13.351652 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:58:13.357304 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:13.358974 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:13.371857 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1442/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:58:23.308009 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:DELETE=4,keystone:SELECT=76,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:58:23.366934 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=3 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:58:41.686095 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:58:41.695666 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77761c6f-11a2-4db1-bc2f-d6ee694254f5 None None] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:58:41.700135 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65f0216a9bf54212a72d41ce9f6cc01c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:58:41.700772 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:58:41.701056 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:58:41.701366 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:58:41.703172 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:58:41.713027 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:58:41.714619 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:58:41.722869 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1458/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:58:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:58:51.719147 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=6 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:31.545578 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:31.547552 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:31.619643 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a7ed1-3061-485a-bbe8-db112945edc2 service neutron] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:31.625914 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:31.626565 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:31.626851 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:31.627127 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:31.629003 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:31.643969 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:31.645593 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:31.657241 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1443/2901] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:59:34.444840 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:34.470003 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74700d-bdcc-4ed4-887a-c2e431c11624 service neutron] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:34.475969 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c5ebd15be54c6badb07f37d58bda07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:34.476632 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:34.476805 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:34.477084 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:34.478899 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:34.492327 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:34.494031 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:34.505861 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1459/2902] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:59:38.285095 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:38.286568 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:38.385013 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5aefa5-13cc-46f3-879b-e9d17e0c5b2d service nova] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:38.390795 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:38.391486 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:38.391769 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:38.392044 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:38.393895 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:38.406027 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:38.407626 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:38.418814 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1444/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:59:41.175801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:41.190310 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba97e9d-2e14-4287-8d21-68cf29d4f0e3 service nova] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:41.196394 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:41.197333 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] REQUEST_METHOD: `GET` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:41.198358 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:41.198843 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:41.200990 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:41.222189 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:41.223989 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:41.235010 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:41.237015 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:41.239344 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1460/2904] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:59:41.356502 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ba9f-12f9-4347-b4c4-daab1b73a985 service placement] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:41.362045 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:41.363608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:41.363608 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:41.363811 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] PATH_INFO: `/v3/users/3e5623694b884f8f94c38d40812563c7` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:41.365394 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5623694b884f8f94c38d40812563c7)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:41.367881 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:41.369662 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=100 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:41.415876 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5623694b884f8f94c38d40812563c7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.423239 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5623694b884f8f94c38d40812563c7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.423873 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5623694b884f8f94c38d40812563c7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.438997 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5623694b884f8f94c38d40812563c7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.446941 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5623694b884f8f94c38d40812563c7'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.454045 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1445/2905] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:59:41 2022] DELETE /identity/v3/users/3e5623694b884f8f94c38d40812563c7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:59:41.638000 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:41.654193 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520d5e-a384-46c1-b752-b4a47593b0d8 service placement] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:41.714660 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:41.715525 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:41.715801 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:41.716071 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] PATH_INFO: `/v3/projects/94433bdea4e24d44a468370a418f79ad` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:41.717305 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94433bdea4e24d44a468370a418f79ad)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:41.719208 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:41.769651 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94433bdea4e24d44a468370a418f79ad', 'request_id': 'req-64e5d57d-fdd0-4d9e-821e-a126b160ec52'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.775125 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94433bdea4e24d44a468370a418f79ad', 'request_id': 'req-64e5d57d-fdd0-4d9e-821e-a126b160ec52'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.781824 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94433bdea4e24d44a468370a418f79ad', 'request_id': 'req-64e5d57d-fdd0-4d9e-821e-a126b160ec52'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.793982 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] The token cache is being invalidate because project 94433bdea4e24d44a468370a418f79ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:59:41.794272 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.794888 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.796418 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1461/2906] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:59:41 2022] DELETE /identity/v3/projects/94433bdea4e24d44a468370a418f79ad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:59:41.800391 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:41.801917 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:41.815614 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6a56-f646-4835-8fce-e5838bfc8fcc admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:41.874101 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:41.874967 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:41.875249 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:41.875524 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] PATH_INFO: `/v3/users/dac4daed6a68456aac947be78dd025cd` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:41.876734 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac4daed6a68456aac947be78dd025cd)` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:41.878693 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:41.925258 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac4daed6a68456aac947be78dd025cd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.932055 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac4daed6a68456aac947be78dd025cd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.933487 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac4daed6a68456aac947be78dd025cd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.945601 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac4daed6a68456aac947be78dd025cd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.953206 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.notifications [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac4daed6a68456aac947be78dd025cd'} {{(pid=90355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:41.954744 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:41.960688 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1446/2907] 10.222.0.45 () {58 vars in 1223 bytes} [Mon May 23 12:59:41 2022] DELETE /identity/v3/users/dac4daed6a68456aac947be78dd025cd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:59:42.137680 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Authenticating user token {{(pid=90356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:59:42.139998 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.fernet_utils [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:59:42.156385 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d57d-fdd0-4d9e-821e-a126b160ec52 admin admin] Validating token access rules against request {{(pid=90356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:59:42.204468 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:42.215298 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725360ad03a444db8a80dca5cc7c54a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42a3411808a2449f8a4f73e9a1925a0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:59:42.216267 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:59:42.216754 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:59:42.217033 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] PATH_INFO: `/v3/projects/f8c400acbcd047b7bc2552ca0baa1a56` {{(pid=90356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:59:42.218257 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c400acbcd047b7bc2552ca0baa1a56)` {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:59:42.220186 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] RBAC: Authorization granted {{(pid=90356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:59:42.267515 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c400acbcd047b7bc2552ca0baa1a56', 'request_id': 'req-ff6d0f94-95c3-41ad-899e-0256a4cfba96'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:42.272893 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c400acbcd047b7bc2552ca0baa1a56', 'request_id': 'req-ff6d0f94-95c3-41ad-899e-0256a4cfba96'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:42.279502 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c400acbcd047b7bc2552ca0baa1a56', 'request_id': 'req-ff6d0f94-95c3-41ad-899e-0256a4cfba96'} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:42.292165 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] The token cache is being invalidate because project f8c400acbcd047b7bc2552ca0baa1a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:59:42.292452 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:42.293070 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG keystone.notifications [None req-ff6d0f94-95c3-41ad-899e-0256a4cfba96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:59:42.294681 dv-cinder-master-3-smb devstack@keystone.service[90356]: [pid: 90356|app: 0|req: 1462/2908] 10.222.0.45 () {58 vars in 1232 bytes} [Mon May 23 12:59:42 2022] DELETE /identity/v3/projects/f8c400acbcd047b7bc2552ca0baa1a56 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:59:51.965536 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=1 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:52.289072 dv-cinder-master-3-smb devstack@keystone.service[90356]: DEBUG dbcounter [-] [90356] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=90356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 13:01:47.941197 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Authenticating user token {{(pid=90355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 13:01:47.942604 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 13:01:48.032204 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ae1b-3252-4373-aa86-61e4ea6ff8e8 admin admin] Validating token access rules against request {{(pid=90355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 13:01:48.091479 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0631d051ad40a598b227671ee2ce0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57d34277a6614a6bb94d5323b6d8d3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 13:01:48.092124 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] REQUEST_METHOD: `GET` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 13:01:48.092410 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] SCRIPT_NAME: `/identity` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 13:01:48.092687 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 13:01:48.094510 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.fernet_utils [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 13:01:48.106276 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 13:01:48.107846 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349d5fe-c7ed-4f97-b05d-83b780935d71 service placement] RBAC: Authorization granted {{(pid=90355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 13:01:48.117858 dv-cinder-master-3-smb devstack@keystone.service[90355]: [pid: 90355|app: 0|req: 1447/2909] 10.222.0.45 () {60 vars in 1365 bytes} [Mon May 23 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 13:01:58.113400 dv-cinder-master-3-smb devstack@keystone.service[90355]: DEBUG dbcounter [-] [90355] Writing DB stats keystone:SELECT=67 {{(pid=90355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}